#Any sort of local framework for generating chats?
2 messages · Page 1 of 1 (latest)
For reference, I get the best perf with GPTQ-for-LLaMa, and I looked at the github page for it and don't really understand how to format anything, which is why the webui mgiht be useful