Immich seems to think some assets are duplicates? | Immich | Page 1

unkempt night Mar 16, 2023, 5:54 PM

#

Does anyone have an idea why immich thinks that more than 50% of my files are duplicates?

When I select the Backup Albums it says that my Recent album has 5488 assets. Then it claims that there are 2341 unique assets which I know is not true. Thus preventing 3k files from backing up.

The files have unique names and are mostly photos taken with the camera of the phone.

proper hawk Mar 16, 2023, 5:57 PM

#

is this on iOS or Android?

unkempt night Mar 16, 2023, 5:57 PM

#

Android

proper hawk Mar 16, 2023, 5:58 PM

#

Can you try to uninstall and reinstall the app?

unkempt night Mar 16, 2023, 5:58 PM

#

Sure brb

#

Huh that did it

#

Thanks Alex!

#

I guess you know exactly why it happens then 🙂 anything i could do to prevent it from seeing them as duplicate in the future?

proper hawk Mar 16, 2023, 6:02 PM

#

Hmm so something has gone wrong with the indexing and saving to the local database

#

We are in the process of refactor some of that indexing part, so this won't be applied in the near future.

unkempt night Mar 16, 2023, 6:04 PM

#

Sounds good 👍

#

Good job on the project - it's amazing

proper hawk Mar 16, 2023, 6:05 PM

#

No problem! Enjoy 🙂

unkempt night Mar 16, 2023, 6:07 PM

#

Ok so there seems to be something else going on

#

While it initially recognized that there's 5488 unique assets

#

As it progress through the upload process, the unique asset counter goes down

#

Along with the Remainder counter

#

But the backup counter remains unchanged

#

Weird eh

proper hawk Mar 16, 2023, 6:09 PM

#

Did you already have upload some of the assets that potentially in the album on the phone through the web or through CLI?

unkempt night Mar 16, 2023, 6:09 PM

#

Yes, they were uploaded through the app before

proper hawk Mar 16, 2023, 6:10 PM

#

It is also possible to check the server and microservices container log to see if there were any error

unkempt night Mar 16, 2023, 6:10 PM

#

I had uploaded some older photos through CLI but those aren't on the phone

#

I'll check the server logs now

proper hawk Mar 16, 2023, 6:10 PM

#

okay

unkempt night Mar 16, 2023, 6:12 PM

#

The only error in the app log is a HiveError: Box Not Found

#

I'll see the server side

proper hawk Mar 16, 2023, 6:12 PM

#

Yeah the server side would be more applicable in this case

unkempt night Mar 16, 2023, 6:19 PM

#

I run it in Docker on Unraid

#

There are no errors in the log

#

Any other place I could check?

proper hawk Mar 16, 2023, 6:19 PM

#

Is this the all in one image?

unkempt night Mar 16, 2023, 6:20 PM

#

You mean as in db+immich in a single image?

proper hawk Mar 16, 2023, 6:21 PM

#

How do you install Immich on unraid, is it through the community image or through Docker-compose?

unkempt night Mar 16, 2023, 6:21 PM

#

Community image

proper hawk Mar 16, 2023, 6:21 PM

#

Hmm then I am not sure

#

Can you show the screenshot of the log?

unkempt night Mar 16, 2023, 6:25 PM

#

proper hawk Mar 16, 2023, 6:33 PM

#

No noticeable error about upload, just weird error about Redis client which I don’t know why

#

Do you mind create a new instance and try again so see if you have the same issue? I suspect there are duplicated from the already uploaded asset before

unkempt night Mar 16, 2023, 6:35 PM

#

That's it, I'm trying to resolve the Redis error but I can't quite figure it out yet.

proper hawk Mar 16, 2023, 6:37 PM

#

I suggest you follow this guide for better support https://immich.app/docs/install/unraid

Unraid | Immich

Immich can easily be installed and updated on Unraid via:

#

Using docker-compose

unkempt night Mar 16, 2023, 6:38 PM

#

docker-compose it is then 🙂

unkempt night Mar 16, 2023, 7:16 PM

#

almost there, immich proxy has a port assignment of 2283(same as community, which I stopped), when i try to open it I get ECONNREFUSED

#

any idea? should I completely remove the community image?

unkempt night Mar 16, 2023, 7:44 PM

#

all good - I was using the wrong DB password. let's see what happens now

high ridge Mar 16, 2023, 8:39 PM

#

I am experiencing something similar as well
I'm on android (play store). I have a couple albums selected which should total 157 assets
But it only says 97 unique assets

#

I am relatively confident that there are no duplicates

#

I am hesitating moving the entire google photos album over (as a test upload ofc, I realize this app is still in the early phases) until this is sorted out

unkempt night Mar 16, 2023, 9:54 PM

#

#

Didn't know they could go negative?! 😁 But at least it looks like everything is backed up properly now on the new instance. I'll try to do an upload through CLI where I'll have some duplicates to see what happens

proper hawk Mar 16, 2023, 10:53 PM

#

negative is a bug that I wanted to fix for so long but still haven't found the root cause yet. Now it is just a cosmetic bug

high ridge Mar 17, 2023, 2:15 AM

#

proper hawk negative is a bug that I wanted to fix for so long but still haven't found the r...

Do you think that having the negative value is related to my issues of having the incorrect asset count?

#

(Mine does not have a negative value btw, it did on the first install but I wiped and now the total count is just wrong)

proper hawk Mar 17, 2023, 3:16 AM

#

I think it is related on the duplicated/unique asset indexing implementation

#

we are refactoring this part in the next couple release so I hope to resolve this one soon

#

it has been bugging me since forever but I haven't been able to track down the root cause. I myself don't experience it but a lot of other people run into this issue.

pure shale Apr 12, 2023, 1:50 PM

#

proper hawk Can you try to uninstall and reinstall the app?

Just adding to that this fixed my issue with Immich as well. Immich though all assets were duplicates and was in a upload loop. MD was iPhone

#Immich seems to think some assets are duplicates?