I have installed Immich few days ago, and only since then backed up my phone, which in total took 3gb, but usage in stats tab went from 20gb to 40gb now, and it keeps growing??
#Continuous File Growth
wicked yacht
ping me if someone replies
i dont see any errors in any container, i originally thought thumbnails, but like 20gb for 500 files?? and i turned off machine learning features and map & gps
torpid hearth
Is there only your pictures on your drive ?
wicked yacht
Is there only your pictures on your drive ?
you mean like only me as a user?
yes
and in meantime it went to 42gb
noone even uploaded anything, no jobs are running
i have this in env, is that directory in container or on machine?
torpid hearth
on your machine
wicked yacht
cant find it
torpid hearth
Do you know where are stored on your machine the assets you uploaded with immich ?
wicked yacht
Do you know where are stored on your machine the assets you uploaded with immich...
uh no, that's kinda what i just asked
torpid hearth
you can find your folder with find / -name library
wicked yacht
you can find your folder with `find / -name library`
found it, what am i looking for now
torpid hearth
Where is it stored, on what disk ?
torpid hearth
40.7 GiB is the size used on your disk; 467 is the size available
wicked yacht
yes, but my disk was on 20gb last 20 days, since i installed immich, and uploaded 3gb of images, it jumped to 40gb
and it still grows for some reason and noone is uploading anything
torpid hearth
Immich creates thumbnails, and encode videos, so even if you upload 3GiB of assets, Immich will store more than 3GiB of files
wicked yacht
but 23gb??
torpid hearth
du -shc library to know what size Immich uses
wicked yacht
shouldn't thumbnails be less size than file itself? it would be logical that it's like 6gb, but 23 more lol
torpid hearth
thumbnails are light, but videos encoded with h264 can quickly fill your disk
wicked yacht
upload dir has 24?
also i noticed that on mobile app, upload bugs out and its stuck on videos often
torpid hearth
Do you have jobs running ?
gusty swallow
upload dir has 24?
Has upload/ thumbs/, encoded-video/, ... within?
wicked yacht
gusty swallow
Oh I see, so in upload are just files?
wicked yacht
also on phone
gusty swallow
The -8 is just a cosmetic bug, we know about that.
gusty swallow
video files
Could you open a random one and see if it's in immich already?
wicked yacht
i mean by my logic i see some connectivity in video's having hard time uploading from phone and there randomly being 24gb upload folder with just videos
one sec
none is in immich
and they are all random
gusty swallow
Hm, those appear to be generated by immich...
Are there files in your encoded video folder?
gusty swallow
thumbs is simillar? Folder structure but no files?
gusty swallow
Which version are you on?
gusty swallow
Can you verify that all original assets are in your library?
wicked yacht
um yeah, all 50X files is there
except few videos on phone that are still failing to upload
gusty swallow
Ok. I'm assuming that the files in upload are the generated encoded video files (idk how they ended up there lol). I think you should be able to just delete all of them and then run transcode video for all assets again
In order to remove some empty folders you could run the migration job after that's done
wicked yacht
i mean they are still continuously generating
gusty swallow
Oh, but there are no jobs running?
wicked yacht
no
gusty swallow
Do you have access to the immich_microservice logs?
And maybe immich_server as well while we're at it
wicked yacht
Do you have access to the immich_microservice logs?
yeah
server
microservices
and my and server time rn is 17:04
or 5pm
gusty swallow
Ok, so microservices had no activity in the last time?
wicked yacht
seems like, yeah
gusty swallow
Just to check the obvious: You don't have multiple instances of immich or the microservices running, right? xD
gusty swallow
Could you stop the backup on your phone and check if there are still files being added?
wicked yacht
i stopped it, now ig just wait and see if that 44gb changes?
ill let you know in few min
gusty swallow
i stopped it, now ig just wait and see if that 44gb changes?
Either that or check if there occur any more files
wicked yacht
ill be checking folder size of uploads and library
gusty swallow
Btw in the meantime could you look into the app's logs?
torpid hearth
The size reported on the bottom left in Immich is the available and total size on your disk, not the size used by immich
wicked yacht
i know, im also checking in terminal
torpid hearth
Nice
wicked yacht
nothing on whole server makes any disk activity except immich atm
gusty swallow
which one, there are many
Either stuff that you think could be related or just a lot and we try sieve through it together
wicked yacht
all just seem to be idle
gusty swallow
Even during the (failed) backup?
gusty swallow
wtf.
wicked yacht
i had random cpu spikes and i checked if there are jobs each time, there weren't
i think its mobile app causing issues(?) and somehow sending broken videos
and then server just fails to process
yeah logs are quiet like on graveyard
my phone tried to upload those videos since 11am as in logs, and it was just sending failed videos whole this time?
gusty swallow
i think its mobile app causing issues(?) and somehow sending broken videos
That's my best guessed currently as well. That somehow the app really is screwed up. But no logs?!
wicked yacht
nop
gusty swallow
Is your app on the latest version as well?
gusty swallow
Hmm
gusty swallow
Yep, that sounds good!
wicked yacht
yeah nothing changes with files on server when backup is stopped
gusty swallow
So the app seems to be the issue, sending (really) broken files to the server
wicked yacht
seems so
gusty swallow
I mean it's a long shot but could you try to just re-install the app? lol
wicked yacht
lets see
reinstalled, turned on background upload and now at the bottom of backup page, i see 1 video uploading so slowwww
and whole server and phone are literally on same network
what exactly "delay new assets backup" does
gusty swallow
Btw which operating system are you on? Not that that would help me personally, but maybe mobile devs would like to know that
wicked yacht
yeah
1 video got uploaded, now second one is, 7%, server storage is same
24gb upload, 2.7 library
and also there's a bug with that "start backup" button
if you swipe to notifications, its state resets and then again sets
and upload process resets?
gusty swallow
Funny lol. Maybe you could open an issue for that (if there is none already)? That would be easiest for the mobile devs
wicked yacht
dont they look here ig
gusty swallow
Yes, but it's easier to keep track of it, mention it in the resolving PR, ask questions specific to that. Here it might get more mixed up and maybe lost
However they may help to figure out the actual issue with the upload * hint hint * :)
wicked yacht
yeah
gusty swallow
1 video got uploaded, now second one is, 7%, server storage is same
This indicates that the upload is working though, right?
And also the server hasn't done anything stupid just yet
wicked yacht
upload works for images perfectly, it breaks on videos
gusty swallow
Yes, you mentioned that 1 video got uploaded, right?
gusty swallow
Oh, that may indicate that I figured out the asset is already on the server
wicked yacht
wicked yacht
Oh, that may indicate that I figured out the asset is already on the server
i did nothing and it again upped by 1gb
rip
will just turn off backup
gusty swallow
Hm, sorry I feel like I don't have anything else...
Maybe @jovial grotto can help? (sorry for the ping)
jovial grotto
Just when I caught up with the thread lol
wicked yacht
its not 100% sure but lol
i run immich via argo tunnels which have 100mb file limit
i mean button bug is still there so its not for nothing afterall
torpid hearth
Ahah it’s often a network issue
gusty swallow
The bot should have a networking command... This way we (I) might think of it more often... :P
torpid hearth
Just to be sure you can connect to your immich instance with the ip/port of the server
wicked yacht
bold basalt
I like traefik, no issues so far
torpid hearth
I like nginx a lot but traefik and caddy are good too
wicked yacht
I like nginx a lot but traefik and caddy are good too
yeah i just got reminded why i didnt use proxy in the first place
dynamic ip and server is in local network
im curious can immich just slice videos into smaller parts when sending them over network?
it would be slow, but at least safer and less headache
bold basalt
dynamic ip and server is in local network
You can just use dynamic dns and a reverse proxy inside your local network. Even if you public IP changes the web address will still point to the correct public IP.
wicked yacht
i have ddns and proxy, but i'd like to point it to cloudflare so i can just use it with dns, and i cant do that since A record requires ipv4, and proxying breaks it too
torpid hearth
im curious can immich just slice videos into smaller parts when sending them ove...
Not yet
wicked yacht
that was sarcasm because yeah i know giving eta's suck
torpid hearth
It’s great for entreprises not for foss 😄
wicked yacht
true
torpid hearth
But you can track GitHub discussions and PRs
wicked yacht
i do that already 🫠