#Live bug - leakage on gpt-3.5-turbo-16k
9 messages · Page 1 of 1 (latest)
I ask for a summary of a tech talk, I get back:
- receipies of carrot cakes
- lists of books recommendations
- answers in spanish
etc..
Check your code. You're probably not sending a query, or you're probably sending an empty one. The model just makes up stuff completely at random if you send it an empty query
ok thanks i will check.
FIXED (not a bug), the new 16k window breaks tooling giving empty prompts, and indeed hallucinated random outcomes
is this documented anywhere? 🙂 that was surprising to me but maybe it's known
this was on yakgpt which is a chat interface with api keys
you can use the prompt at pastebin called sDQ8CD7F
i do see people reporting similar behavior on openai official chat with some prompts...