coral siren
Hey guys I made a little game where the api generates a little story and gives the player always 3 chances. Now it randomly happen that the response is empty it looks like this (image attached).
Any ideas why and how I can prevent that when doing the api call?
ivory peak
What is the prompt and stop sequences that you're sending it? Empty responses are usually an issue with the prompt, the model did not find anything to autocomplete, or it came across one of the stop sequences
coral siren
What is the prompt and stop sequences that you're sending it? Empty responses ar...
My whole data looks like this:
I dont really provide a stop squences
At the end the code does this
API Request with start prompt => let the player choose => send the start prompt and the response from the start prompt with the info what the user selected => and this in a loop until the game is ending
I have the feeling that the prompt creates a own stop squences
Could my issue get solved when I provide a unique own stop sequence that never get triggered? And is this okay? And for what is the stop sequence ?
finite belfry
Maybe your prompt+response exceeds 900 tokens and this somehow causes this? You should try increasing it temporarily.
I found someone with similar issue as you, take a look at adrianneestone's post:
https://community.openai.com/t/gpt-3-responding-with-blank-text/39623/6
Try these and tell us if these have solved your issue?
ivory peak
My whole data looks like this:
To the prompt, add another line that says like
Generation:
and see what happens with that
fierce wyvern
Add a newline at the end of your prompt. It thinks you provided the completion. The new line will tell it you want it to do something
coral siren
`Generation:`
I try this and see what happen
coral siren
Maybe your prompt+response exceeds 900 tokens and this somehow causes this? You ...
this also can be true the prompt gets really really long
I now changed the tokens limit to 1200 and added a "Generation:" at the end in a new line. I see now if something happen again or if its "fixed" now thanks that you all replied :)
ivory peak
Awesome!
coral siren
after some days i now didnt saw the issue anymore so i wohld guess its fixed