#Is it possible to set vl models like qwen3 vl model series in runpod serverless endpoints?

3 messages · Page 1 of 1 (latest)

north narwhal
#

Hey guys, I was wondering if anyone has deployed a mixed model or multi modal model in runpod, coz I have been facing issues whenever I tried to load the model in runpod using the serverless vLLM repos.

left hingeBOT
#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

open portalBOT