Traceback (most recent call last): File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\server.py”, line 68, in load_model_wrapper shared.model, shared.tokenizer = load_model(shared.model_name) File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\modules\models.py”, line 95, in load_model output = load_func(model_name) File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\modules\models.py”, line 272, in GPTQ_loader model = modules.GPTQ_loader.load_quantized(model_name) File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\modules\GPTQ_loader.py”, line 169, in load_quantized if len(shared.args.pre_layer) == 1: TypeError: object of type ‘int’ has no len()
#Traceback error when loading model
1 messages · Page 1 of 1 (latest)
ive tried multiple things and even a new install but still it pops up with the same error
Not obvious what's wrong, but the first step woould be to look at line 169 and figure out what's going on. It looks like it may be model-specific.
Sounds good I'll take a look at it when I have, thanks!
How would I go about looking at the line? Like I take it it's in a cmd but the error doesn't show up in the normal cmd when it happens
It's probably getting a bad variable passed in if it works when you think you're replicating it from the command line.
So, up to the calling code, line 272 in GPTQ_loader
It seems as though my GPTQ_loader.py only has 201 lines
oh lol
line wrap makes your paste hard to follow
line 272