#how to setup GPTQ-for-LLaMa one click installer?

1 messages · Page 1 of 1 (latest)

steady eagle Apr 24, 2023, 2:09 PM

i usedthe one click installer for windows but i have an error where i am missing a file text-generation-webui\repositories\GPTQ-for-LLaMa, does anyone know how to fix it?

any ideas or suggestions would be extremly helpful

lucid wraith Apr 24, 2023, 2:20 PM

follow the instructions here
https://github.com/oobabooga/text-generation-webui/blob/main/docs/GPTQ-models-(4-bit-mode).md

GitHub

text-generation-webui/GPTQ-models-(4-bit-mode).md at main · oobaboo...

A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA. - text-generation-webui/GPTQ-models-(4-bit-mode).md at main · oobabooga/text-generation-w...

if you don't know how to activate the conda env you can run cmd_windows.bat and it will activate it for you