#Docker image pulling gets stuck

7 messages · Page 1 of 1 (latest)

indigo galleon
#

Since yesterday's night I can't pull a container properly. It gets stuck at half and doesn't download any more. I know the image is huge, since the models are baked into it. But it was doing just fine on Feb 8 with the same exact image.

royal bloomBOT
#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

feral citrusBOT
feral citrusBOT
timber wasp
#

can you please open a ticket for staffs to check this, please click that button

indigo galleon
#

I will attach here more details of my case. So far, I didn't get good tips to resolve this. And I feel quite like there's not much I can do.

Serverless workers can't pull large Docker images — previously working images are now also failing.

Setup:

  • ~74GB image from private Docker Hub repo (Pro plan, authenticated)
  • Serverless endpoints across EU and US locations, for different GPU types -- A40, rtx4090.
  • Smaller images pull fine, only large ones affected

Log pattern:

  1. Download progresses normally (~1.5GB/min)
  2. At ~30GB, download abruptly jumps to showing 74.43GB/74.43GB (false completion)
  3. Immediately enters retry countdown (5s, then 10s)
  4. Restarts download from 0 — no resume, full restart
  5. Loops indefinitely

This is a regression — the same images were pulling successfully before. Nothing changed on my side (same registry, same credentials, same image tags).

Happy to share endpoint ID and full logs if needed. @timber wasp

indigo galleon
#

btw, I solved the issue by re-building the container with layers of smaller size. I wish support could have suggested it tho. It took me some time, haha.
I hope it will help someone else just in case.