#using meta-llama/Meta-Llama-3.1-8B-Instruct in servelss

2 messages · Page 1 of 1 (latest)

quaint pond
#

i am trying to run meta-llama/Meta-Llama-3.1-8B-Instruct in serverless, what is right vllm/vllm-openai image version to use?

deft fieldBOT
#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution