#gpt 4 rate limit error

1 messages · Page 1 of 1 (latest)

mild sand
#

I have developed one project using Azure gpt 4 api. But now I am facing issue with scalability. It is processing the request one by one. How can I make it available for 1000 customers at the same time? Thanks in advance

stone field
#

You can apply for a quota limit increase on the website

grizzled quest
#

This can be solved using thread and streaming.

#

Please consider creating thread based on user's request and close thread after response created.