#Could not find the quantized model in .pt or .safetensors (Solved, wrong model loader.)

1 messages · Page 1 of 1 (latest)

bitter junco Jul 21, 2023, 11:33 PM

That isn't a GPTQ model. Use Transformers to load it.

violet flame Jul 21, 2023, 11:41 PM

Could not find the quantized model in .pt or .safetensors (Solved, wrong model loader.)