The following columns in the training set don't have a corresponding argument in PeftModelForCausalL | Unsloth AI | Page 1

pliant zealot Dec 2, 2024, 12:24 PM

#

I keep getting this warning message when I do dpo :The following columns in the training set don't have a corresponding argument in PeftModelForCausalLM.forward and have been ignored: prompt, chosen, rejected. If prompt, chosen, rejected are not expected by PeftModelForCausalLM.forward, you can safely ignore this message. Dpo seems to work fine though but I want to be sure because I am going to invest a lot of time on that.

serene river Dec 3, 2024, 6:13 AM

#

I don't think I got any of that error when I use DPO for my project .-.

pliant zealot Dec 4, 2024, 3:41 PM

#

serene river I don't think I got any of that error when I use `DPO` for my project .-.

is there any chance you can share your code with me? I did many runs with different configurations and always get it. However if I do training directly without unsloth I dont get it anymore.

serene river Dec 5, 2024, 6:05 PM

#

I am not exactly using DPO (I use KTO instead) and my frend is the one who's using DPO

#

📎 message.txt

#The following columns in the training set don't have a corresponding argument in PeftModelForCausalL