I'm using ChatGPT and sometimes the response given by the Node SDK it's too slow. Whenever I try it sometimes it gets stuck and won't give and response until 30s are past, at least. How is this possible if I'm using the turbo model, which is supposed to be faster and it's a paid API.
#API response too slow sometimes
gilded kettle
livid glade
It is because the model gets overloaded
tame python
Ugh. I am having the same issue. Would trying another model be faster?
floral vector
Yes same issue here. I’ve implemented backoff and some requests have been fixed. Still many problems
mystic sluice
嗨
gilded kettle
Some calls to the api get stuck and won't give a response in at least half a minute. I "fixed" by adding a timeout and remaking the call again if that timeout it's triggered, but it's a shame because it's not live response, and gives the appearance of a bad tool which has 1999's internet.
wheat imp