#OSError: models/... does not appear to have a file named config.json.

3 messages · Page 1 of 1 (latest)

tight tusk
#

Hi,

I am new to text generation webui and I am trying to run the model on the CPU. I followed the instructions here https://github.com/oobabooga/text-generation-webui/blob/main/docs/llama.cpp.md

e.g. I downloda a model by entering models/TheBloke_NexusRaven-13B-GGUF and a file name in the download section and this appears to work

But when I try to start using the model I am seeing the following error message:
OSError: models/TheBloke_NexusRaven-13B-GGUF does not appear to have a file named config.json. Checkout 'https://huggingface.co/models/TheBloke_NexusRaven-13B-GGUF/None' for available files.

Is this a problem in this text generation web ui or the bloke's data?

GitHub

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models. - oobabooga/text-generation-webui

#

It does appear the file name is not self chosen but it need to be in the list.

tight tusk