#vLLM serverless endpoint workers going unhealthy

2 messages · Page 1 of 1 (latest)

night jolt
#

A basic setup with only the model link and no other changes is not working
LLM models tried -
https://huggingface.co/Qwen/Qwen3.5-9B
https://huggingface.co/meta-llama/Llama-3.1-8B
https://huggingface.co/google/medgemma-27b-it

Qwen/Qwen3.5-9B · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

meta-llama/Llama-3.1-8B · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

google/medgemma-27b-it · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

ornate elbowBOT