GPT-4o constantly making up answers

[fiery storm]

Steps to reproduce:
I asked it specific information about me.

Expected result:
If it didn't have that info, it should have said it doesn't know.

Actual result:
It just keeps making up answers. If I tell it it's wrong, it makes up another one. When I ask it where it got the answer, it says it actually doesn't know but that if I tell it, it will remember (but it won't).

Additional information
Browser: Chrome
OS: MacOS

[shut dock]

Thank you for reporting a bug related to ChatGPT.

If relevant and not already provided, we recommend adding a link to the associated ChatGPT conversation and uploading any relevant images here for easier troubleshooting.

➜ Need to contact OpenAI support? Visit https://help.openai.com

[restive thicket]

Have they started bring down gpt4o’s abilities? Mine was ripping through problems left and right early in the week

[fiery storm]

No idea, but I've never seen it blatantly making up things like this before.

[wispy jasper]

Did you save this information in memory or something? LLM models are trained to give you answer, often times even if you incentivize it to say I don’t know when it doesn’t know, it will. Otherwise I’m not really surprised it’s giving an answer.

While it’s probably a regression compared to other models, it’s not really surprising

[eager vortex]

I asked it about a TV show from years ago and it made up a new TV show with plot, and suggestions for episodes

[rocky prism]

its just halucination

[brave flicker]

this is just how LLMs work

don't ask questions that prime it to hallucinate

this is not a bug