Just started happening and was working fine minutes ago. Small tests work, but anything big breaks
#Timeouts across all models constantly
manic river
tight owl
Hmm yeah same issue. Seems like when a requests takes more than 5 - 10 second to fulfill, openrouter sends a timeout
at least it's not being charged
random berry
Works for me
tight owl
yeah, very short statement work
I did a difference with same system prompt etc (something that I expect 2k+ token out of)
when I wrote "Ok just say hello", it answered in 2sec
when I wrote the normal thing, it takes about 10sec then openrouter sends a timeout error
"{'error': 'Operation timed out. Please try again later.'}"
it was still working ~20min ago though
potent hound
Hi!
manic river
this is breaking a few apps
random berry
@mellow flare @cursive storm I can confirm that these timeouts happen with some paid models with longer prompts (a few k tokens)
maiden roost
me too
potent hound
I am getting the following error back: Exceptional status code: 408 {:status 408, :body "{"error":"Operation timed out. Please try again later."}", :version :http2, :headers {"server" "cloudflare", "x-clerk-auth-reason" "token-invalid", "content-type" "application/json", "access-control-allow-origin" "*", "content-length" "56", "x-clerk-auth-message" "Invalid JWT form. A JWT consists of three parts separated by dots. (reason=token-invalid, token-carrier=header)
maiden roost
potent hound
I just created a new token
random berry
Okay, we know there is problem, no more conformations needed for that.
maiden roost
{"error":"Operation timed out. Please try again later."}
random berry
{"error":"Operation timed out. Please try again later."}
Literally see my message above yours
Now we have to wait for the cavalry to show up, paging @civic zenith
random berry
Not yet, obviously.
rotund delta
thin jackal
mine too
civic zenith
fix is about to live, will post an announcement
thin jackal
amazing, thanks @civic zenith
random berry
Seems to be working again for me.
manic river
woohoo I don't actually write code anymore so I was useless for a few minutes there LOL
civic zenith
#announcements message
mellow flare
Sorry folks about the downtime 🙏
potent hound
what was the reason?
random berry
what was the reason?
My guess this was tested -> #general message
potent hound
Hm, okay thanks, if you need a hand with integration tests let me know.
blazing sandal
Sure we're fixed? Getting these now 👀
<ClientResponse(https://openrouter.ai/api/v1/chat/completions) [200 OK]>
<CIMultiDictProxy('Date': 'Sat, 21 Dec 2024 01:38:21 GMT', 'Content-Type': 'application/json', 'Transfer-Encoding': 'chunked', 'Connection': 'keep-alive', 'Access-Control-Allow-Origin': '*', 'x-clerk-auth-message': 'Invalid JWT form. A JWT consists of three parts separated by dots. (reason=token-invalid, token-carrier=header)', 'x-clerk-auth-reason': 'token-invalid', 'x-clerk-auth-status': 'signed-out', 'Vary': 'Accept-Encoding', 'Server': 'cloudflare', 'CF-RAY': '8f5426f4de17230c-SJC', 'Content-Encoding': 'gzip')>
Getting these after about 50 requests to get completions for Qwen 2.5 72B Instruct via DeepInfra
blazing sandal
Still getting this