#Error code: 404 'The model `mistral-7b-openorca` does not exist'

4 messages · Page 1 of 1 (latest)

empty bladeBOT
#

Hi @honest nimbus. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:

#

Based on the information provided in the extracts, it seems like you're trying to use the mistral-7b-openorca.Q4_0.gguf model with the GPT4All application. However, there might be a few issues that could be causing the error you're encountering.

  1. Model Download: Ensure that the model mistral-7b-openorca.Q4_0.gguf is downloaded and placed in the correct directory. The model files are usually stored in a directory like %LOCALAPPDATA%\nomic.ai or %APPDATA%\nomic.ai on Windows, and /Users/someone/Library/Application Support/nomic.ai/GTP4All on macOS. You can manually download the model from the URL <https://gpt4all.io/models/gguf/mistral-7b-openorca.Q4_0.gguf> and place it in the correct directory.

  2. API Base URL: The base URL for the API should be <http://localhost:4891/v1,> not <http://localhost:4891/v1/chat/completions.> The latter might be causing the 404 error.

  3. Model Name: The model name should be mistral-7b-openorca.Q4_0.gguf, not mistral-7b-openorca. Make sure you're using the correct model name in your code.

Here's how your corrected code might look:

import openai
from openai import OpenAI

openai.api_base = "<http://localhost:4891/v1"> # Corrected API base URL

openai.api_key = "not needed for a local LLM"

# Set up the prompt and other parameters for the API request
prompt = "Who is Michael Jordan?"

# Make the API request
client = OpenAI()
completion = client.chat.completions.create(
    model="mistral-7b-openorca.Q4_0.gguf", # Corrected model name
    messages=[{"role": "system", "content": "you are helpful assistant"},
              {"role": "user", "content": prompt}],
)

print(completion)
#

Please note that these suggestions are based on the information provided in the extracts and might not completely solve your issue. If the problem persists, it would be best to raise an issue on the GPT4All GitHub page (https://github.com/nomic-ai/gpt4all/issues).

Sources:

Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:

#

@honest nimbus kapa.ai is still learning and improving, please let us know how it did by reacting below