#Lost my hard drive, restored the main photos but now thumbnails are all giving errors. What do?

1 messages · Page 1 of 1 (latest)

fringe bluff
#

My hard drive recently died. I had it backed up to s3 so I downloaded my photos. I had uploaded them to the folder structure that immich created, but I had (dumbly) not uploaded everything. I only uploaded what I thought were the main pictures and did not bother with the thumbnail folders. Specifically I uploaded based on the below regexes:

/20[12][0-9]/
/original/
library//20[12][0-9]/

so based on those regexes I think I got id/year/* files (old photo structure), id/original/* (also old folder structure) and then finally library//number/ (new photo structure).

That means I didn't save anything from the upload, thumbs, profile or encoded-video files.

My first question is, did I lose any data? I am hoping not based on what I uploaded...
The second question is, how do I make the immich app "work" again? Should I click 'thumbs -> generate all" in the admin tab to fix everything? Or do I need to run more jobs?

outer briarBOT
#

:wave: Hey @fringe bluff,

Thanks for reaching out to us. Please follow the recommended actions below; this will help us be more effective in our support effort and leave more time for building Immich immich.

References

Checklist

  1. :ballot_box_with_check: I have verified I'm on the latest release(note that mobile app releases may take some time).
  2. :ballot_box_with_check: I have read applicable release notes.
  3. :ballot_box_with_check: I have reviewed the FAQs for known issues.
  4. :ballot_box_with_check: I have reviewed Github for known issues.
  5. :ballot_box_with_check: I have tried accessing Immich via local ip (without a custom reverse proxy).
  6. :ballot_box_with_check: I have uploaded the relevant logs, docker compose, and .env files, making sure to use code formatting.
  7. :ballot_box_with_check: I have tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

fringe bluff
#

Note I skipped 6 cause i dont think there are relevant logs to my situation... For reference some of the images I lost are now showing with the error message in the logs:

[Nest] 7 - 10/09/2024, 11:39:31 PM ERROR [Microservices:JobService] Error: Input file is missing: upload/library/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/2023/2023-05-20/FullSizeRender+2.jpg

[Nest] 17 - 10/09/2024, 11:38:56 PM ERROR [Api:GlobalExceptionFilter~jgnycgnd] Unknown error: Error: ENOENT: no such file or directory, access 'upload/profile/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/e99159c6-0a98-4024-98f2-f27ec5aa5f0d.png'

[Nest] 17 - 10/09/2024, 11:38:52 PM ERROR [Api:GlobalExceptionFilter~mmf12v8t] Unknown error: Error: ENOENT: no such file or directory, access 'upload/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/thumb/CLI/791b591e-ed1a-40db-adee-2ccf8aea1d50.webp'

Essentially I see no such file errors for files in the profile and in the thumb/CLI folders. The input file errors I'm not entirely sure what they are related to though

floral bronze
fringe bluff
#

These folders come from immich..I think I used some form of the prior storage template and then at some point the storage template changed and I didn't bother changing it?

I mount /mnt/storage/photos:/usr/src/app/upload for immich-server

A sample of my actual files are the below:

(Probably old storage template?)

/mnt/storage/photos/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/2023/2023-01-01/IMG_1234.HEIC

/mnt/storage/photos/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/original/50f536eed16ca9d230d5bfbd92dbb2111cc018140207ef082fbd26b0592ff94b/c6e79149-ee1b-4ad4-ab67-eeca29be195c.jpg

(Probably the new storage template?:)
/mnt/storage/photos/library/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/2024/2024-01-01/IMG_6712.HEIC

The above folders are the only ones saved and uploaded to S3. I actually saved it with the exact same file paths because I wanted in the worst case to just download these to the exact same location and then ideally the app would just work again.

Anyways, after downloading it to those folders and opening immich again, in my current app I also see the below as well. (There's more files in these folders below, but I only share 1 file from each of the folders of encoded-video, thumbs, upload). There's also a profile folder but its empty.

/mnt/storage/photos/encoded-video/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/f1/ba/f1baa031-21b2-42c6-88ab-73d69492ae3e.mp4

/mnt/storage/photos/thumbs/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/a8/67/a8673590-7f00-4db1-899c-996c599b3ea8-preview.jpeg

/mnt/storage/photos/upload/e99159c6-0a98-4024-98f2-f27ec5aa5f0d/2e/ff/2effb305-2d50-4d94-8458-0131de314320.MOV

TLDR:

  1. my hdd got corrupt
  2. I got a new one and downloaded the files back to the same location they were in, but I had not backed up the thumbs, the encoded-video, the profile and the upload folder.
  3. I opened immich on phone.. Thumbnails don't show up, some errors logs for my server are linked above . When I click an image, I don't see anything but can download the actual picture.
floral bronze
#

Thumbs and encoded-video are low res copies of originals. Upload and library is where your original photos are stored (that you uploaded with immich)

fringe bluff
#

Ok, so I queried the database and there were 66 files that were stored with an originalPath of upload/upload% so presumably I lost 66 files. That's not bad tbh but now I know that upload is supposed to be saved. For the others, how can I make things "work" again? What would I need to "generate all thumbnails" from scratch? Is it enough to go to the admin page and hit the generate thumbnails for all button? Or alternatively should I delete something in the db and then run it all?

I'm assuming any machine learning or whatever related stuff (search, geo etc) is fine since that is presumably still existing in the db?

floral bronze
fringe bluff
#

thanks i'll try that and see if there are any issues