#First Time setup + cluster fucked photo dump

13 messages · Page 1 of 1 (latest)

teal patio
#

Hello,

So setting up immich for the time for someone, then will set it up for myself as well.

the other person has their photos and videos various different places. Google photos + iCloud + old SD cards + old phone + old backups etc.

I have managed to get everything onto 1 harddrive, however these folders and files are an absolute cluster fuck. albums duplicating, missing files in some, videos in another.

there's 2 questions.

  1. what's the best way to sort these out while preserving folder structure (essentially albums), dedeplucating etc.

  2. how to bulk upload to immich preserving these albums?

i have yet to setup immich, but im familiar with docker and all.

there's approx 250gb of photos including multiple duplicates etc.

For 1. was thinking maybe some AI thing to merge albums based on similar folder/filenames. heard some people talking about jev or clef some ai stuff.

for 2. not sure at all

cinder etherBOT
#

:wave: Hey @teal patio,

Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich immich.

References

#

Checklist

I have...

  1. :blue_square: verified I'm on the latest release(note that mobile app releases may take some time).
  2. :blue_square: read applicable release notes.
  3. :blue_square: reviewed the FAQs for known issues.
  4. :blue_square: reviewed Github for known issues.
  5. :blue_square: tried accessing Immich via local ip (without a custom reverse proxy).
  6. :blue_square: uploaded the relevant information (see below).
  7. :blue_square: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

Information

In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:

  • Your docker-compose.yml and .env files.
  • Logs from all the containers and their status (see above).
  • All the troubleshooting steps you've tried so far.
  • Any recent changes you've made to Immich or your system.
  • Details about your system (both software/OS and hardware).
  • Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
  • The version of the Immich server, mobile app, and other relevant pieces.
  • Any other information that you think might be relevant.

Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

teal patio
#

also, the google photos export is year wise, so not sure how to merge that with the existing photos which are in albums

jovial blaze
#

If you want to be thorough, probably the way to go is to use czkawka for a first pass

#

If you upload to immich-go I think that does some cleanup/dedupe itself as well

#

ultimately you will have to do some part manually though, which is probably easiest to do in Immich

teal patio
#

what is immich-go ?

#

what about album preservation (folder structure). could probably have it cleaned through czkawka, but uploading to immich?

jovial blaze
teal patio
analog eagle
#

Another side note, before doing anything else, I think it would be very helpful to run something like exiftool on all these photos and just confirm that they all have date in their metadata.

#

You also might want to plan ahead and figure out what you actually want to do. For example, if there's duplicates, which folder is supposed to be the correct one? If you just run through and dedup without thinking about this, you might be frustrated later that the duplicate was removed from the wrong place.

#

My suggestion, do these imports piece by piece, one source at a time, and ideally figure out a way to move away from folders for albums, ideally just using that folder structure to make something like an album or a tag in metadata instead. (I think immich go can do this also, but need to explore).

teal patio
#

i was thinking of merging the folders first, cuz alot of the folders have the same name (i.e the same album) and then dedupe them there

teal patio
#

about 6 main folders, over 25,000 photos woohoooo