Serverless Active workers

[keen aspen]

Hey I am running one active worker but yeah its costing me even when its idle maybe because its running continuously but then what is the benefit of serverless, should be billed when only used right? if i put active workers to 0 , will a worker be assigned for that request , and i noticed that gpus may not be available then?

[flint spade]

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

[stone marten]

Don't keep an active worker, it's very costly without much benefits. When there are zero active workers, one worker will warm up from a cold start and process the request and get cold.

That's the best way to use the serverless endpoints

[keen aspen]

Ohh Thank youu! But what if there is no availability of gpus?

[stone marten]

It's mostly that the availability of GPUs becomes low

Try using the pro models if you want though