#Issue with the duplicate detection algo during upload

1 messages · Page 1 of 1 (latest)

somber grove
#

hey i have this SETUP on my old macmini 2018 intel.

so the thing is i recently found this SELF-HOSTABLE photos app so i tried upload my 1 TB hard drive now the problem is i am doing this in batches but some folders have thumbnail of the photo and the original copy too. so what's happening is for some of the photos thumbnail get uploaded first and then the original get tagged as duplicate. the problem with deleting thumbnails and only keeping originals is that there are fking 8k photos and originals are around 2k i came up with that number cause only 2k photos are bigger then 100kb(yep these are pictures from 2000 some mobile and old cam so yeah low resolution). so is my only option to keep reducing the the boundary like first upload picture bigger then 100kb then 50kb then 25kb then 20kb then 15kb.

no other way???? yeah well i am considering keeping the thumbnails for those i don't have the originals. will try to get these scaled by ai in future.

compact groveBOT
#

:wave: Hey @somber grove,

Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich immich.

References

#

Checklist

I have...

  1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
  2. :ballot_box_with_check: read applicable release notes.
  3. :ballot_box_with_check: reviewed the FAQs for known issues.
  4. :blue_square: reviewed Github for known issues.
  5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
  6. :ballot_box_with_check: uploaded the relevant information (see below).
  7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

Information

In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:

  • Your docker-compose.yml and .env files.
  • Logs from all the containers and their status (see above).
  • All the troubleshooting steps you've tried so far.
  • Any recent changes you've made to Immich or your system.
  • Details about your system (both software/OS and hardware).
  • Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
  • The version of the Immich server, mobile app, and other relevant pieces.
  • Any other information that you think might be relevant.

Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

tribal drum
#

If the thumbnails have a specific naming pattern you can do a search for the filename. Other than that, the duplicate detection tool will select the bigger of the two images.