Hi, I'm using the OPEN AI API to create a discord bot. I am reusing threads instead of regenerating them every time to make the bot remember the conversation, but if I do this, will the number of tokens requested to the API keep increasing every time I ask a question? Please give me your opinion.
#Is there an increase in usage of the OPEN AI API?
gaunt saddle
oblique skiff
Hi, I'm using the OPEN AI API to create a discord bot. I am reusing threads inst...
yes it will increase to the mode max context size https://platform.openai.com/docs/assistants/how-it-works/managing-threads-and-messages
gaunt saddle
yes it will increase to the mode max context size https://platform.openai.com/do...
Okay, so is it not possible to delete the messages in a thread, rather than deleting the thread itself, to prevent an increase in API requests?