so i had a few quick questions can i train a lora for gguf models? i'm using mixtral. i believe only transformers can train right? but i heard gguf doesn't work with transformers? also my data set was made for chatgpt with chat completion, i have them written now so entire scripts are taken into context and used. such as an entire script of tv show with one character marked as assistant but I'm only seeing examples for QnA type training. my goal is essentially character but through the lora.
#Lora Training and Datasets
idle sky
fickle pebble
https://huggingface.co/mistralai/Mixtral-8x7B-v0.1 this version of Mistral you can likely use for training. You want a non-gguf and using bitsandbytes can load in a lower precision like 4-bit so you can fit it in memory.
