Claude 3.5 sonnet tool call empty response

[fading nexus]

Hello.

I'm getting empty response from Claude 3.5 sonnet tool calls. It calls tools properly, and I return it the results. After that it just returns me empty text.

Request & response...

Am I missing something in the request?

I will add that if I use gpt4o or gemini, this exact same request works perfectly

Also note that I use it through OpenAI lib

[little knot]

Hmm @fading nexus I couldn't reproduce yesterday. Would you mind share the full code you used to invoke the above payload?

[timber slate]

@little knot I am getting some users reporting the same, looking at the logs just empty response

also using openai js sdk

doesnt happen all the time but happens often

[little knot]

Do you log the provider returning the empty result?

[timber slate]

user sent me logs from app, and response was empty

I will try to reproduce and will send you request / response if that is helpful

[little knot]

That'd be great

[timber slate]

May be its a feature :)) I've seen Sonnet respond with empty string - means its done and nothing else to do

I'll send you sreenshots first, and then logs

Its only happens on anthropic/claude-3.5-sonnet .

anthropic/claude-3.5-sonnet:beta behaves as expected

[little knot]

woh no way.....

[timber slate]

^ anthropic direct api

:beta (see model at the top)

anthropic/claude-3.5-sonnet

Last message is just empty

[little knot]

Can you check the provider that's returning empty message?

[timber slate]

Amazon

[little knot]

I suspect it's Amazon

[little knot]

HOLY SHUT

Will work on a fix for this today, together with the issue we've got reported with Gemini 2 Flash as well

BTW, could you also share the full request in JSON form?

I think I have an idea of what the shape might trigger this error (we have monitor)

but if you can share your request, I can make sure it works on my test

(feel free to DM me or @blissful oriole )

[timber slate]

Done