#Error on `response_format` does not support streaming

6 messages · Page 1 of 1 (latest)

peak surge
#

In this case, I'm not streaming a response (but it appears that openrouter is behind the scenes maybe?) because I'm getting the below error ... is there a workaround in the meantime? to force openrouter to not stream the proxied request?

{
  "model": "qwen/qwen2.5-32b-instruct",
  "messages": [
    {
      "role": "system",
      "content": "Respond ONLY with JSON."
    },
    {
      "role": "user",
      "content": "writeBlogPost({\"about\":\"EPCIS 2.0\"})"
    }
  ],
  "response_format": {
    "type": "json_object"
  },
  "seed": 3
}

getting this response

{
  "error": {
    "message": "Provider returned error",
    "code": 400,
    "metadata": {
      "raw": "{\"error\":{\"message\":\"response_format` does not support streaming\",\"type\":\"invalid_request_error\"}}\n",
      "provider_name": "Groq"
    }
  }
}
rough plazaBOT
#
Automated Response

The error indicates that Groq, the provider for qwen/qwen2.5-32b-instruct, does not support response_format with streaming. To work around this, you can try excluding Groq in your API request using provider routing, or using models that support response_format. Since Azure does not support json_schema structured outputs, exclude Azure in your API request or wait for OpenRouter to address the issue.

⚠️ Disclaimer

This is an AI-generated response and may not be 100% accurate. If you have further questions or need clarification, please ping @desert verge for assistance.

Confidence

9/10

Feedback

❌ This response was marked as not helpful. A staff member will review this thread.

React with ✅ if this helped, or ❌ if it didn't answer your question
rough plazaBOT
#

@desert verge A user has indicated that the automated response wasn't helpful.

peak surge
#

@desert verge is there a workaround here?

desert verge
#

hmmm yeah this one is tricky, we always stream

#

I'm not sure that there is a workaround