#Serverless vLLM deployment stuck at "Initializing" with no logs

4 messages · Page 1 of 1 (latest)

lusty snow
#

I've been trying for hours, initially I was trying to deploy Ollama on Serverless GPU, not working, stuck at initializing. Now I am directly using the Serverless vLLM option and it is still not working. Every time I click the deploy button, it just says "Initializing" and there's nothing more, no logs whatsoever. Any idea? Thanks!

warped lake
#

What GPU did you use? It could be the case, where the selected GPU is not available.

elder agate
#

or you don't have access to pull the image or model.

lusty snow
#

I'm using the 24GB GPU, looks like it is unavailable?