doublepost
Servers
›
Text Generation WebUI
›
help-forum
›
Trying to run TheBloke_dolphin-2.5-mixtral-8x7b-GPTQ getting an error with every model loader
#Trying to run TheBloke_dolphin-2.5-mixtral-8x7b-GPTQ getting an error with every model loader
2 messages · Page 1 of 1 (latest)
echo summit
Dec 19, 2023, 11:44 PM
#
What about Exllamav2 loaders?
ripe hemlock
Dec 19, 2023, 11:55 PM
#
echo summit
What about Exllamav2 loaders?
still loading will take a while