#response token count accuracy

1 messages · Page 1 of 1 (latest)

unreal stratus
#

I seem to be having a problem with the token count accuracy in the api responses for chat competition. IE: I send a short prompt and api says completion_tokens is 350 which seems incorrect. When I count the content message myself, I get 455 tokens.

When I paste the same content back to the api by itself as a prompt, the api says that prompt_tokens is 455. Using tiktoken.