you are supposed to do that on your | OpenAI | Page 1

small zinc Sep 20, 2023, 5:58 PM

#

I was going to track that on the backend but I see your point

austere latch Sep 20, 2023, 6:00 PM

#

with the token tracking you are also supposed to manage and queue your clients requests so you wont get rate-limited by openai

small zinc Sep 20, 2023, 6:04 PM

#

Not sure how to do that, just figured requests would throttle if they actually hit the rate limits

austere latch Sep 20, 2023, 6:06 PM

#

OpenAI Platform

Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.

#

if you dont add any mechanisms then it will lead to errors it there is too much usage at the same time

#you are supposed to do that on your