Qwen/Qwen2.5-VL-3B-Instruct
Anybody able to make it work?
When it will be supported?
#Can’t make Qwen/Qwen2.5-VL-3B-Instruct model work on serverless
lethal flume
lethal flume
@shy solstice can you help?
sullen monolith
have you tried using dev image for workers or tried to build your own? i am asking cause i want to run those models too, but see that there is an issue with transformers version
lethal flume
have you tried using dev image for workers or tried to build your own? i am aski...
I am nooby not sure how to use dev image. I know that if I use dev transformers it works though. I tried locally
sullen monolith
I am nooby not sure how to use dev image. I know that if I use dev transformers ...
ahh, awesome! i will try building an image then
i am also new to runpod, but willing to give it a try
will ping you if i succeed 🙂
btw, is 3b equally impressive as 72b in it's own weight class? 72b basically has the best ocr i ever saw, better than gemini and claude