#not possible GPT is making things up
14 messages · Page 1 of 1 (latest)
Playground keeps context by having the previous text available in the playground
And can we do that too with the API ?
Sorry, I reformulate : how can we do that with the API ?
Should I send the whole conversation with the prompt ? But I guess I will be charged for all the tokens each time ?
@torn kraken sorry to ping you, but if you have an idea ?
I'm not sure what exactly is the best way to do that style. I suspect it's just passing all past convo as part of the prompt up to 4000 words IIRC
Ok thanks ... yes it seems that you have to do like the examples in the playground, replay the wole conversation (with "characters" asking and answering) to trigger the right completion
Alright I guess I can do without it
Hey Yeah
Sending the whole conversation in the prompt
You can reduce it by summarizing the conversation using gpt3 itself but it won’t be that much less of a reduction
In my bot when conversations get to 3000 tokens, it summarizes and reduced the conversation