Hey, My every worker in idle mod and still got time difference in the complete process.
#I got time variation in serverless workers, I don't know but every worker used RTX 4090
dim zinc
pure bridge
Can you explain more?
dim zinc
I try to generate the same image in idle worker but I faced issue with time variation like some of worker take time less than 30sec but at the same time few of them are taking more than 40sec.
pure bridge
okay there is this technology called flashboot
i think thats what makes it faster
but for the first time you send request, it will be slower because it needs to load things
dim zinc
right but we can see requests send to other workers and that's also taking less time
I also enable flash boot
pure bridge
What do you mean, what are you assuming?
that seems normal
What things do you do on your worker's startup?
or before calling the handler
dim zinc
Oh I thought every worker used the same GPU and I got a time difference of about 15-20 seconds, and each time I check the worker id and see the performance
pure bridge
Oh I thought every worker used the same GPU and I got a time difference of about...
are they running the same job?
what are they running?
dim zinc
are they running the same job?
yes