#not possible GPT is making things up

14 messages · Page 1 of 1 (latest)

whole minnow
#

Ok, thanks
But how do ChatGPT and Playground keep a context, then ?

cosmic leaf
whole minnow
#

And can we do that too with the API ?

#

Sorry, I reformulate : how can we do that with the API ?

#

Should I send the whole conversation with the prompt ? But I guess I will be charged for all the tokens each time ?

#

@torn kraken sorry to ping you, but if you have an idea ?

torn kraken
#

I'm not sure what exactly is the best way to do that style. I suspect it's just passing all past convo as part of the prompt up to 4000 words IIRC

whole minnow
#

Ok thanks ... yes it seems that you have to do like the examples in the playground, replay the wole conversation (with "characters" asking and answering) to trigger the right completion

#

Alright I guess I can do without it

cosmic leaf
#

Sending the whole conversation in the prompt

#

You can reduce it by summarizing the conversation using gpt3 itself but it won’t be that much less of a reduction

#

In my bot when conversations get to 3000 tokens, it summarizes and reduced the conversation