#Issue with iOS uploads on new Immich instance

1 messages · Page 1 of 1 (latest)

glacial dagger
#

I have set up a new Immich instance and I have uploaded the photo library from my iPhone.

The issue I am running into is that there are about 300 assets that haven't been uploaded and they are not in the Duplicated Assets list in the app settings.

The logs don't show anything amiss either.

I can't go through 95k assets to find the ones that are missing.

Are there any other places I should be looking to see if they are marked somewhere else for not to be uploaded?

tiny driftBOT
#

:wave: Hey @glacial dagger,

Thanks for reaching out to us. Please follow the recommended actions below; this will help us be more effective in our support effort and leave more time for building Immich immich.

References

Checklist

  1. :ballot_box_with_check: I have verified I'm on the latest release(note that mobile app releases may take some time).
  2. :ballot_box_with_check: I have read applicable release notes.
  3. :ballot_box_with_check: I have reviewed the FAQs for known issues.
  4. :ballot_box_with_check: I have reviewed Github for known issues.
  5. :ballot_box_with_check: I have tried accessing Immich via local ip (without a custom reverse proxy).
  6. :ballot_box_with_check: I have uploaded the relevant logs, docker compose, and .env files, making sure to use code formatting.
  7. :blue_square: I have tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

tiny driftBOT
trim burrow
#

How are you connecting the app? reverse proxy, cloudflare etc

glacial dagger
#

Locally

#

I have another instance of Immich running and this one didn't have the asset issue this one is

trim burrow
glacial dagger
#

Yep. Locally

#

I have an album on the phone that has 194 assets. Syncing to Immich shows only 177. On the older instance, it shows 194

glacial dagger
#

Restarted the container and now it shows this

[Nest] 7  - 09/25/2024, 5:14:29 PM     LOG [Microservices:StorageService] Verifying system mount folder checks

[Nest] 7  - 09/25/2024, 5:14:29 PM   ERROR [Microservices:StorageService] Failed to read upload/encoded-video/.immich: Error: ENOENT: no such file or directory, open 'upload/encoded-video/.immich'

[Nest] 7  - 09/25/2024, 5:14:29 PM   ERROR [Microservices:StorageService] The "encoded-video" folder appears to be offline/missing, please make sure the volume is mounted with the correct permissions
#

I then took down the container, changed the upload location and now it is showing these errors even more

#

I now cannot setup Immich because it keeps spewing out these issues in the logs. Am I going to have to reinstall my entire system for these to go away?

trim burrow
#

If you moved folders, you need to move the contents of the folder, including the hidden file .immich

#

You can recreate it as an empty file if it got lost in the move

#

one should be in each folder in UPLOAD_LOCATION

glacial dagger
#

I didn't move anything. It just couldn't find anything. I completely removed Immich containers and everything related to it. I changed the upload location and then did docker compose up -d so it was a brand new instance. Why is it looking for a file if it is a brand new instance and not creating everything from scratch?

trim burrow
#

Once you’ve started it up once it’s no longer a brand new instance, if you are using the same database location

#

It’s missing files that it already created. If you really want to reset it you need a new upload location and a new DB_DATA_LOCATION

glacial dagger
#

Ah ok. That makes sense. All sorted now. Back to uploading everything again to see if it can count everything properly

glacial dagger
#

I think it's time to bow out of running Immich. The iOS app is painfully slow with no fix in sight. The app says there are a certain number of pictures in an album but then doesn't upload all of them and doesn't mark them as duplicates. The albums don't sync properly (even when taking the painfully slow and time-consuming step of syncing them one by one).

The instance doesn't appear to be using my GPU for transcoding anymore. The transcoding at the initial setup was lightning fast. It was transcoding a 16GB file in about 5.5 minutes. Now it's down to 35-50 minutes for this. This is no difference to the other instance I have with specs that are worse than the machine I am running this instance on. There is so much wrong now that it just isn't sustainable for me anymore. It's a shame too because I was recommending to my friends to use and I will no longer do that.

I'm doing a local (yes, ip:port) upload and it's just stupid slow at doing this compared to the first instance (on this machine) I installed. It's absolutely not the network or hardware. I'm running a docker container of immich on a core 6 i7 with 32gb RAM with the DB on an M.2 NVME drive and the storage is on SSD's. The network itself is a dual teamed NIC giving 2GB speeds.

If anyone has any suggestions that might solve these issues, pointers would be good.

trim burrow
#

What OS are you using?

#

None of what you mention is normal / expected for the vast majority of users

young dirge
tiny driftBOT
young dirge
#

We also will be logging more information about the stuck file in the next release

#

which should be out today

glacial dagger
# trim burrow What OS are you using?

Debian 12. The other machine also has Debian 12 on it. That machine is an i5 processor with 4 cores and has 16GB ram and only onboard graphics. I just checked a 4GB video on this machine that has better specs and it took 90 minutes to transcode. That same video on the machine with worse specs transcoded in half that time.

When the first upload on this better machine was done the transcoding was lightning fast but it is no longer. I restarted Immich because of the album sync issue (that wasn't there on the machine with worse specs) and now it just is painfully slow.

The photos were all downloaded from iCloud last week and are sitting locally on the phone so there shouldn't be any need for it to download from iCloud

glacial dagger
young dirge
glacial dagger
young dirge
#

can you help showing the screenshot?

glacial dagger
#

Sure. Here are some screenshots. Phone album showing Belgrade and 471 items. Other machine album showing 471 items. New machine showing 466 items. App showing no duplicates. About 15% of the albums synced yesterday had this discrepancy on the new machine

IMG_0011.png IMG_0014.png IMG_0012.png IMG_0013.png
young dirge
#

ah the albums sync has some bug in there

#

I think if you go to the backup option and press the sync button, it will populate all the assets in the album

glacial dagger
#

So… the process I did on both machines was to allow everything to upload (selecting only recents). Then I selected the albums one-by-one and hit sync. First machine this was fine. Second machine this didn’t work. I had to press sync once to get the albums to show up. I then had to press sync twice to get the album contents to sync. This new machine has the issue. No matter how many times I hit sync, it’s just not syncing properly.

Another question I have: if I bulk upload from my desktop and then turn on uploads from the app, will this cause issues and duplicates?

young dirge
#

as long as the files have the same content, duplicated file will be rejected by the server

#

the asset-album sync mechanism depends on the albums sync as well, so as we know that you have issue with large amount of albums sync, it is understandable that you are seeing some discrepancies here. It will likely be resolved once we optimize and fix the album sync issue

glacial dagger
#

I get what you’re saying, but surely only selecting one album to sync on a brand new install and a fresh install of the iOS app shouldn’t have this discrepancy right from the start though?

young dirge
#

but the instance doesn't have one album per your screenshot, the albums sync include remote + local albums to be populated in the local device database

glacial dagger
#

When I first installed it I did it with one album only (just as a test) and it had issues syncing right from the start

young dirge
#

I see, does clicking on the sync album button in the backup page help fully populating the albums?