⚡|serverless

2030 threads · Page 1 of 41

DeepSeek V4 Flash Serverless 2 messages
Check your serverless costs, I've been billed nearly $200 for a disabled endpoint 4 messages
(Copy Fail) Linux Kernel Vulnerability can permit container escape 3 messages
Solved
B200 GPUs unavailable. 3 messages
All my requests are failing 2 messages
Serverless endpoint stuck at 0 workers 2 messages
Gemma4 is not working(serverless) via vLLM v2.14.0. 15 messages
Unable to increase container disk space (stuck at 5GB) 8 messages
Initializing to throttle loop for vllm. runpod never works! 6 messages
why is every serverless in NA and EU down most of the time.its mostly low supply or unavailable 3 messages
Serverless workers nightmares 2 messages
Slow Startup & Partial Rollout Issue 6 messages
Serverless Deployment Webhooks 5 messages
CUDA initialization fails on one RTX 5090 serverless worker but succeeds on another identical worker 4 messages
Request in endless Queue, no workers are starting 3 messages
Queue
Appreciate the worker fitness checks! 3 messages
It'd be great if the Requests tab displayed the timestamp for the request 3 messages
EUR-NO-1 region giving cuda not available 5090 GPUs 2 messages
MiniMax 2.7 2 messages
Workers stuck in image pull 8 messages
"Please report this machine to RunPod" 5 messages
ComfyUI-to-API loading forever 8 messages
Un-throttle My Endpoint 3 messages
Constant throttling 3 messages
Serverless workers boot successfully but never receive jobs. confirmed 2 regions multiple GPU's 5 messages
Queue
Not working at all day 2 6 messages
Queue
Cannot create GPU Pods with custom docker image 4 messages
GPU choice is currently low 12 messages
Serverless CPU endpoint not getting created 4 messages
cuda>=12.8 3 messages
vLLM serverless endpoint workers going unhealthy 2 messages
Getting this randomly on RTX PRO 6000 RuntimeError: CUDA unknown error. 3 messages
"Delete All Outdated Workers" please!! 32 messages
Queue
If we maintain a certain number of active workers, can we guarantee that GPUs will remain available 4 messages
Sometimes Receiving Models without CUDA 4 messages
Queue
Manually changing config on a separately created endpoint in one DC changes config on another 4 messages
Container killed 137 2 messages
Unable to update serverless endpoint config due to invalid GPU pool ID error 3 messages
How do I use serverless for koboldcpp 2 messages
OmniVoice 2 messages
Problems with Serverless 2 messages
20min delay GPU serverless , help pls 2 messages
How long will it take to get a serverless process done? 3 messages
How many 4090s 5090s on 12.7, 12.8, 12.9, 13.0 CUDA (SERVERLESS) 2 messages
Cannot update serverless endpoint settings 4 messages
Builder
Serverless workers never initialize - stuck IN_QUEUE forever 4 messages
gemma-4 2 messages
Builder
RunPod Serverless still deploy on RTX A5000 but not L4 6 messages
All my workers are getting stuck in image pull: pending for one of my endpoints. 11 messages
All my workers are throttled for extended periods 2 messages