CUDA_LAUNCH_BLOCKING=1 | Text Generation WebUI | Page 1

near magnet Oct 26, 2024, 5:05 PM

#

I cant load the models

keen onyx Oct 26, 2024, 5:13 PM

#

what is your GPU?

near magnet Oct 27, 2024, 3:49 PM

#

nvidia geforce 930mx (i forced it)

keen onyx Oct 27, 2024, 3:50 PM

#

that's a Maxwell GPU, you won't be able to use exllamav2 (so no GPTQ nor exl2 models)

#

try to find GGUF quants, they can be run on your GPU

near magnet Oct 27, 2024, 3:51 PM

#

any alternative?

#CUDA_LAUNCH_BLOCKING=1