#Traceback error when loading model

1 messages · Page 1 of 1 (latest)

lunar jungle
#

Traceback (most recent call last): File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\server.py”, line 68, in load_model_wrapper shared.model, shared.tokenizer = load_model(shared.model_name) File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\modules\models.py”, line 95, in load_model output = load_func(model_name) File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\modules\models.py”, line 272, in GPTQ_loader model = modules.GPTQ_loader.load_quantized(model_name) File “M:\OobaboogaTextGen2\oobabooga_windows\text-generation-webui\modules\GPTQ_loader.py”, line 169, in load_quantized if len(shared.args.pre_layer) == 1: TypeError: object of type ‘int’ has no len()

lunar jungle
#

ive tried multiple things and even a new install but still it pops up with the same error

lunar jungle
#

Using the webui on windows 10 also

#

Traceback error when loading model

normal quartz
#

Not obvious what's wrong, but the first step woould be to look at line 169 and figure out what's going on. It looks like it may be model-specific.

lunar jungle
lunar jungle
normal quartz
#

It's probably getting a bad variable passed in if it works when you think you're replicating it from the command line.

#

So, up to the calling code, line 272 in GPTQ_loader

lunar jungle
normal quartz
lunar jungle
#

oh lol

normal quartz
#

line wrap makes your paste hard to follow

lunar jungle
normal quartz
#

so the model_name isn't getting passed in right

#

your mission, should you choose to accept it, is to find out why

#

int is probably an error code

#

and len() is intended to measure the length of a string