#Best path forward after losing half of immich folder data

1 messages · Page 1 of 1 (latest)

pine dome
#

I'm trying to pick up the pieces after a disastrous turn of events. I'd been neglecting the "3" in the 3-2-1 backup strategy out of laziness/optimism. After a year or so of running immich with a daily restic backup, I had a couple nights getting errors from my backup routine. I couldn't figure out what was going on, ended up messing up by starting a new backup that overwrote the previous one (I know 😔), part way through the backup my main storage drive which Immich was on died. Massive I/O errors from an NVME. Had a couple brief moments trying to ddrescue before it became fully unresponsive. I think most of the data will be recoverable from other sources, but given how much time had gone into setting this up, cleaning metadata, and the likelihood that many videos of my baby's 1st year of life will be missing I was willing to pay a premium at a data recovery lab; but alas they couldn't salvage anything.

Sob story over, moving forward now. I have been restoring the parts of the backup that was done before the drive died. It looks like 40% of the size I would expect from the immich folder is there, the postgres folder isn't there. It looks like the backups folder in immich survived, so I should be able to reconstruct the database. I'm guessing at that point I can scroll through and quickly get a sense of what is ther and what thumbnails/files are gone. I guess my questions are

  1. Is there any kind of tool that identifies content expected in the database that is missing in the library/uploads folders? I have been searching here but "missing photos" doesn't quite get me in the right ballpark
  2. Is there any kind of export tool like google takeout for Immich? I'm wondering if given how much is gone from my library, would it be cleaner to start a fresh library and re add everything. My concern is how much date/time metadata I cleaned up with large sections of google/whatsapp photos that tended to just have timestamp of when it was downloaded.
spring ravineBOT
#

:wave: Hey @pine dome,

Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich immich.

References

#

Checklist

I have...

  1. :blue_square: verified I'm on the latest release(note that mobile app releases may take some time).
  2. :blue_square: read applicable release notes.
  3. :blue_square: reviewed the FAQs for known issues.
  4. :blue_square: reviewed Github for known issues.
  5. :blue_square: tried accessing Immich via local ip (without a custom reverse proxy).
  6. :blue_square: uploaded the relevant information (see below).
  7. :blue_square: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

Information

In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:

  • Your docker-compose.yml and .env files.
  • Logs from all the containers and their status (see above).
  • All the troubleshooting steps you've tried so far.
  • Any recent changes you've made to Immich or your system.
  • Details about your system (both software/OS and hardware).
  • Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
  • The version of the Immich server, mobile app, and other relevant pieces.
  • Any other information that you think might be relevant.

Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

chilly stag
#

  1. @hoary eagle has a tool for this

  2. no, you already have all the originals on disk with the XMP files. Thats the “takeout”

twilit olive
chilly stag
#

Even if we had an exporter it wouldn’t work with the catastrophic loss you’ve had

pine dome