is assistant API more token efficient than the chat API?
like do you still have to send the "you are a so and so assistant" everytime with assistant api call?
#i have a question for people who are familiar with the API's
tribal hill
pallid herald
The assistant uses quite alot more tokens than chat. You do not have to keep telling it you are an assistant etc during a session. If you disconnect and start a new session (you stop your code or app from running, then restart it) you do have to remind it, but only once at the beginning of your conversation. It has a memory so that if you tell it to act or roleplay as someone/something, tell it details about yourself, it will remember it for the duration of your session (unless your session is really long/uses alot of tokens, where it will forget stuff to make room for new stuff).