wispy nova
I am currently trying to implement a GPT-3.5-Turbo powered character Chatbot command.
The problem I face is one of token efficiency: the sum of the tokens for the system message can surpass the token's used for the user's prompt and response, combined. I also want to be able to remember past interactions for each user, adding a bit of complexity there too.
Is there currently a method to set this system message once, possibly every time a new client is instantiated? Any help is appreciated!