Made my own model. Monarch. Mistral base. I sloth and one GPU

[tough bluff]

https://github.com/JohannaWeb/Monarch/tree/nonComedyGoldMonarch

I mean unsloth

Built with:

PyTorch - for model training
LoRA (Low-Rank Adaptation) - efficient fine-tuning
Transformers - HuggingFace stack

Proof

Kinda a standard stack. Pytorch. Lora for fine tuning, transformers and unsloth not to burn my house down