#Qwen2.5 0.5b worked out of box and Qwen3 0.6b failed

3 messages · Page 1 of 1 (latest)

pure narwhal
#

with error

ValueError: The checkpoint you are trying to load has model type `qwen3` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

Seems like I need a newer version of transformer library like

pip install --upgrade "transformers>=4.41.1"

Can I describe required environment? Like cog files?
Should I use handler function or docker image?

frozen frigateBOT
#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

frigid sleet
#

you can build a new VLLM image using theupdated version package if you want