This error is caused by a subprocess crashing during the dataset map operation, often due to hardware limitations or issues with multiprocessing on your system. The recommended fix is to set dataset_num_proc=1 in your SFTConfig to disable multiprocessing, which should resolve the error and allow fine-tuning to proceed. This is a hardware/environment-specific issue, not a bug in Unsloth itself. See the discussion and solution in Unsloth Issue #2693.
Would you like more detail on why this happens or how to further debug it?
Sources:
spare mason
sage roverBOT