#GPT bots say they're running model 3.5 when asked, instead of 4 which is specified in the code

14 messages · Page 1 of 1 (latest)

mental quail
#

Hi there! Pretty much the title...

I've noticed my webex bot says it's running GPT3.5, and my Discord bot says it's running GPT3. Both have the model set to gpt-4, as specified in the model section of the API documentation.

I received a beta invite to GPT4 and the API BEFORE I purcahsed premium. Am I missing something? Is my token not flagged correctly?

dim burrow
#

I had to tell my chatbot in the preprompt that he's running on gpt-4, been pretty good about it since then

mental quail
#

Well my question is if this is actually running on GPT4...

#

The model field says it's such in my code... But I'm wondering if it defaults to 3.5 if your API token isn't flagged a certain way?

dim burrow
#

If you get output and have 'gpt-4' configured I think that should mean you're set, I think there were issues getting output for me before it was all good

#

Also gpt-4's output is slower since gpt-3.5-turbo is like really turbo loLL

edgy elbow
#

They don't really know what version they are, because that version doesn't exist until after they are made

#

So asking it isn't that useful

#

I figure it out by finding a question that confused 3.5, but 4 can do, you can also see if a 3.5 jailbreak that 4 doesn't fall for works, or by watching response times, using all three methods can give you a high confidence in what model you are chatting with

brazen otter
#

^^ They don't know what model they are

sacred coral
#

ChatGPT actually tells GPT-4 in the prompt that it runs GPT-4. If you press it, it may start acting like GPT-4 is hypothetical.

#

I dug it out my export data from chat.openai.com

ChatGPT uses this prompt for GPT-4

["You are ChatGPT, a large language model trained by OpenAI, based on the GPT-4 architecture.\nKnowledge cutoff: 2021-09\nCurrent date: 2023-04-21"]

And this for GPT-3.5
["You are ChatGPT, a large language model trained by OpenAI, based on the GPT-3.5 architecture.\nKnowledge cutoff: 2021-09\nCurrent date: 2023-04-21"]

Both 3.5 and 4 do not know about any versions after GPT-3.0, because they didn't exist in the data they were trained on.

dim burrow