I want to limit the length of the text generation (chat style), but unless I set the max-tokens to about 100 or higher, it tends to end in the middle of a word or sentence. Is it possible to make it finish sentences when using a low max-tokens limit? Using examples in the prompt doesn’t work.
#How to make GPT-3 (Davinci) end sentences?
compact pecan
frozen bone
also state on your prompt that you want a short answer
compact pecan
also state on your prompt that you want a short answer
I’ve edited the prompt many times, mentioning several times that I want a short answer. The prompt has ten example messages and replies, each in just one short sentence, 25 tokens or less, yet it frequently generates long sentences or multiple sentences, so it gets cut off since the token limit is at 25.
Just noticed you sent that last year. Didn’t mean to necro
frozen bone
would you mind sharing the prompt?