Slowish Downloads | Runpod | Page 1

worldly barn Sep 3, 2024, 7:25 AM

#

I'm trying to setup a pod running ComfyUI for Flux at the moment, and it's going to take 30-40 mins just to download the models with the speed it's running at.

Downloading: https://huggingface.co/black-forest-labs/FLUX.1-dev/resolve/main/flux1-dev.safetensors

     0K .......... .......... .......... .......... ..........  0% 10.9M 34m23s
204800K .......... .......... .......... .......... ..........  1% 10.3M 35m7s
409600K .......... .......... .......... .......... ..........  2% 10.4M 34m59s
614400K .......... .......... .......... .......... ..........  3% 10.5M 34m40s
819200K .......... .......... .......... .......... ..........  4% 13.7M 32m47s
1024000K .......... .......... .......... .......... ..........  5% 11.9M 32m4s
1228800K .......... .......... .......... .......... ..........  6% 11.6M 31m36s
1433600K .......... .......... .......... .......... ..........  7% 22.0M 29m23s
1638400K .......... .......... .......... .......... ..........  7% 20.4M 27m46s
1843200K .......... .......... .......... .......... ..........  8% 12.3M 27m34s
2048000K .......... .......... .......... .......... ..........  9% 11.2M 27m35s
2252800K .......... .......... .......... .......... .......... 10% 12.5M 27m18s
2457600K .......... .......... .......... .......... .......... 11% 12.6M 27m0s
2662400K .......... .......... .......... .......... .......... 12% 18.6M 26m6s
2867200K .......... .......... .......... .......... .......... 13% 13.6M 25m44s
3072000K .......... .......... .......... .......... .......... 14% 10.8M 25m46s```

Download speed has been much faster in the past. 

Pod ID: v4kbmqzmcyr3yf

hollow olive Sep 3, 2024, 8:29 AM

#

yeah should b 3-4x that speed , what command did u use to download ?

worldly barn Sep 3, 2024, 9:04 AM

#

the script is just using wget

#

it was running this provisioning script: https://raw.githubusercontent.com/ai-dock/comfyui/main/config/provisioning/flux.sh

hollow olive Sep 3, 2024, 9:53 AM

#

wget --header="Authorization: Bearer <HF_Token>" url

#

^^ command i use replace <HF_Token> with your hf token

#

no brackets

woven patrol Sep 3, 2024, 10:06 AM

#

Experiencing the same issue again, we transferred from EU-is-1 because it was terribly slow, but now the RO Secure cloud is slow as well. These slowdows are started like a month ago, and we cannot continue using Runpod if this issue persist any longer. We are losing prestige because of this.

2024-09-03T10:02:48Z 79d44721116c Downloading [===========> ] 987.1MB/4.481GB
2024-09-03T10:02:48Z 79d44721116c Downloading [===========> ] 987.6MB/4.481GB
2024-09-03T10:02:48Z 79d44721116c Downloading [===========> ] 988.2MB/4.481GB
2024-09-03T10:02:49Z 79d44721116c Downloading [===========> ] 988.7MB/4.481GB
2024-09-03T10:02:49Z 79d44721116c Downloading [===========> ] 989.3MB/4.481GB
2024-09-03T10:02:49Z 79d44721116c Downloading [===========> ] 989.8MB/4.481GB

worldly barn Sep 3, 2024, 10:08 AM

#

woven patrol Experiencing the same issue again, we transferred from EU-is-1 because it was te...

Yeah I gave up waiting earlier, not keen on paying for an hour of waiting on downloads. Hopefully something can be fixed

woven patrol Sep 3, 2024, 10:10 AM

#

Yep, we are getting calls from paying customers nonstop

hollow olive Sep 3, 2024, 10:19 AM

#

with that command i download flux1.dev in about 9mins

woven patrol Sep 3, 2024, 10:21 AM

#

Okay you are probably using another datacenter or another machine in the datacenter.

hollow olive Sep 3, 2024, 10:21 AM

#

EU-SE-1

#

normally on a A40

woven patrol Sep 3, 2024, 10:22 AM

#

Okay we are experiencing the slowdown in the RO datacenter

hollow olive Sep 3, 2024, 10:23 AM

#

if you download it with the command i posted how fast is it ?

woven patrol Sep 3, 2024, 10:23 AM

#

We are not even there, currently the image is still pulling

hollow olive Sep 3, 2024, 10:24 AM

#

what image ?

woven patrol Sep 3, 2024, 10:24 AM

#

Docker image

hollow olive Sep 3, 2024, 10:24 AM

#

the pod ?

#

which template ?

woven patrol Sep 3, 2024, 10:24 AM

#

Custom

hollow olive Sep 3, 2024, 10:24 AM

#

ahhh

#

idk then dude , mayb put in a support ticket

#

takes me about 30-40 tops to restart from scratch when i trash a pod

#

where are you pulling your docker container from ?

#

fuck that server is painfully slow

woven patrol Sep 3, 2024, 10:40 AM

#

The image was publicly hosted on github, but it was insanely slow so I rehosted it on docker hub, it helped somewhat.

hollow olive Sep 3, 2024, 10:47 AM

#

yeah i was going to say put it on docker hub , I just spun up a pod and downloaded the template i normally use and its slow af

#

might be an idea to change servers

polar stirrup Sep 3, 2024, 11:07 AM

#

Also slow for serverless image downloading from Docker Hub. On a CPU machine (cpu3c-32-64)

ionic sparrow Sep 3, 2024, 10:47 PM

#

I'm experiencing the same issue downloading from dockerhub on EU-RO-1

#

We can't use runpod with this type of performance, we need to be able to scale up and down faster than this. If this doesn't get resolved we'll be forced to look for an alternative.

orchid ploverBOT Sep 4, 2024, 8:33 AM

#

@worldly barn

Escalated To Zendesk

The thread has been escalated to Zendesk!

ionic sparrow Sep 4, 2024, 8:33 AM

#

👌