#Trying to run Unsloth models using vLLM with Kubernetes.

2 messages · Page 1 of 1 (latest)

split panther Mar 22, 2025, 7:06 PM

📎 message.txt

I am trying to run Unsloth models using vLLM with Kubernetes. Unfortunately, I keep running into the same error with every model. What am I doing wrong?