Recipe for Llama 4 Scout on vLLM | Runpod | Page 1

shut elk Aug 22, 2025, 12:02 AM

#

I am trying to follow this Llama 4 recipe from vLLM and deploy it on Runpod Serveless.
Even using 2 x H100 or a B200, I could not deploy the LLM.
Has someone managed to deploy it?

rose compassBOT Aug 22, 2025, 12:02 AM

#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

shut elk Aug 23, 2025, 5:00 PM

#

https://github.com/runpod/docs/issues/358

GitHub

[Request] Runpod Serverless Version of the Llama4-Scout Deployment ...

I was going through the excellent Llama 4 Scout on vLLM recipe Would it be possible to provide a version of this recipe adapted for Runpod vLLM Serverless In particular, guidance on the required GP...

muted frigate Aug 24, 2025, 4:20 AM

#

Thank you for making an issue! I've changed the assignee to the right individual.

carmine quarry Aug 24, 2025, 5:55 AM

#

maybe, instead use vllm from quick deploy on runpod's serverless home

#

im sure you can follow to setup the arguments/ parameters from vllm when deploying from quick deploy

#Recipe for Llama 4 Scout on vLLM