Bug Report:
I have noticed that conversations with GPT-4 on ChatGPT will unexpectedly switch to the GPT-3 model (with the attempted usage of Plugins) after:
A) switching to another conversation in ChatGPT and switching back to your original conversation
OR
B) switching to the "New chat" UI and then switching to your original conversation
Steps to reproduce:
- have GPT premium account and plugins access
- start a new conversation with GPT-4
- send a message to your conversation with GPT-4 (message contents are irrelevant)
- switch to another conversation on ChatGPT (any) OR click the "New chat" button
- switch BACK to your original conversation with GPT-4 (the one started in step 2)
- send a message to your original conversation with GPT-4
Expected result:
The continuation of my pre-existing conversation with the GPT-4 model. Default ChatGPT behavior.
Actual results:
- (after step 5, before step 6) at the top of our message history "Model: GPT-4" switches to "Model: Plugins Alpha"
- (after step 6) text reading "The previous model used in this conversation is unavailable. We've switched you to the latest default model" appears above the next GPT response (note, this message is inaccurate: it switches to GPT-3, not GPT-3.5, which is the current default model as of 4/27/2023)
3.ChatGPT responds with its GPT-3 model (Green OpenAI icon, no longer refers to itself as "based on GPT-4", specifically refers to itself as GPT-3 and not 3.5) - the user is unable to continue their original interaction with the GPT-4 model, conversation continues using GPT-3
I am not able to link my video demo & narration of this behavior due to Discord rules (video is on my google drive because I used Screencastify) but feel free to reach out if you are interested.
Additional information
OS: Windows
Browser: Chrome
ChatGPT Account: Premium
ChatGPT Plugins: Code Interpreter, Plugins (access to store enabled but none installed)
GPT Models: 4, 3, text-davinci-002