fringe lichen
It changes the way the loss is calculated when training a lora -> i.e. it ignores the loss on input tokens and only trains the model on the completion token loss. Essentially allowing the model to concentrate entirely on learning to produce the output, at the cost of not learning to produce the input (which is what I want).
vocal roost