provider are gmicloud and baseten , always invoke baseten, when gmicloud's throught is 106 and baseten's throught is 72. The parameter below:
extra_body={
"provider": {
"quantizations": ["fp8"],
"sort": "throughput",
"only": ['gmicloud','baseten']
}
},
#Deepseek v3 0324 parameter sort not work
broken hearth
quaint wyvernBOT
I'm an AI assistant - my answers may be incorrect and I cannot see screenshots. Please verify information with the OpenRouter docs.
To help debug this issue, can you provide the following details:
- What specific model/version are you using (full model string)?
- The exact API endpoint and full request payload you are sending
- The full response you are receiving (not just the part about the provider)
- What behavior you expect, and what is actually happening
These details will help determine if the provider selection parameter is being used as intended or if there is an issue with how throughput is being sorted.
-# This is an automated response. Use !mute to stop the bot from responding.
broken hearth
when i change the parmeter "only": ['gmicloud','baseten'] --> "only": ['gmicloud','nebius'], gmicloud are invoked correctly