Quantize R-1 3B | Unsloth AI | Page 1

severe scarab Jan 31, 2025, 12:58 AM

#

Hi, has the code to quantize the r-1 system been released? I would love to try quantizing the smallest R-1 model if possible.

safe marlin Jan 31, 2025, 5:45 AM

#

We already quantized the smallest distilled R1 model

#

Btw the distilled small ones aren't actually R1

#

severe scarab Feb 7, 2025, 2:50 AM

#

I was actually wondering if you guys distilled their 3B parameter by any chance?

#

Thanks so much for open sourcing btw

safe marlin Feb 10, 2025, 7:08 PM

#

Yes it's there too 🙏

#Quantize R-1 3B