#Chat Completion Api , multi user context or session management

1 messages · Page 1 of 1 (latest)

dusky coyote
#

2 users A, B
A asked a question (Qa) - AI response (Ra)
B asked a question (Qb) - AI response (Rb)
A asked a follow up question on Qa (Qaa) – How Chat completion api knows this is related to Qa (unless historical dialog -Qa is also sent as part of this prompt) ? can we maintain session ? or we need to pass history of messages on every call ?

#

Chat Completion Api , multi user context or session management

white dirge
#

You need to give it context, yes.
So if you want full memory you have to pass previous interactions back in every call.

#

You can summarize to save some tokens.