I still have my database in the postgres folder but when I launch immich, it asks me to create admin | Immich | Page 1

warped fog Sep 11, 2024, 3:35 AM

#

I tried to secure access via https using certbot. In that process I added a cert and then modified the .yml. The data is still intact and it looks like the files within the postgress folder are still there, with the expected dates on them. Can I get back to what I had?

I backed up the .yml file before doing anything. When I restore that, it asks me to create an admin account.

I need help, please.

wanton palmBOT Sep 11, 2024, 3:35 AM

#

:wave: Hey @warped fog,

Thanks for reaching out to us. Please follow the recommended actions below; this will help us be more effective in our support effort and leave more time for building Immich immich .

References

Container Logs: docker compose logs docs
Container Status: docker compose ps docs
Reverse Proxy: https://immich.app/docs/administration/reverse-proxy

Checklist

:ballot_box_with_check: I have verified I'm on the latest release(note that mobile app releases may take some time).
:ballot_box_with_check: I have read applicable release notes.
:ballot_box_with_check: I have reviewed the FAQs for known issues.
:ballot_box_with_check: I have reviewed Github for known issues.
:ballot_box_with_check: I have tried accessing Immich via local ip (without a custom reverse proxy).
:ballot_box_with_check: I have uploaded the relevant logs, docker compose, and .env files, making sure to use code formatting.
:ballot_box_with_check: I have tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

wanton palmBOT Sep 11, 2024, 3:38 AM

#

wanton palm :wave: Hey <@275749640970960896>, Thanks for reaching out to us. Please follow ...

Successfully submitted, a tag has been added to inform contributors. :white_check_mark:

warped fog Sep 11, 2024, 3:38 AM

#

I'm happy to upload any logs needed.

📎 env 📎 docker-compose.yml 📎 docker-compose.yml.attempt

white bear Sep 11, 2024, 4:16 AM

#

Did you also modify your .env?

#

what is the output of docker volume ls?

warped fog Sep 11, 2024, 4:29 AM

#

white bear Did you also modify your .env?

I did not modify the .env file.

warped fog Sep 11, 2024, 4:30 AM

#

white bear what is the output of `docker volume ls`?

Here is the output:

~/immich-app# docker volume ls
DRIVER    VOLUME NAME
local     1edfb986df8fd05dbdb2ccde2b180d0150b9fa6245c62518c9797355c6a552a5
local     2ef810130513e7d19b9f17d22e8923a5e24d5427236ae7977369269fa24a0568
local     4a452b2b380fa06d58112bc74d968ff0e87651e2dd61f3db1298bc8ebb02ed70
local     96d13ae46488fc3d7f68e3f314adfacbe43226a3cca4506abd3631820c680947
local     b8de2949d5877964bf2107da824787fa754390ca4acf36285d1f622d429381c8
local     bc8473cec7c6f9b456532356a9dc90ff354c58b43b97c123af71ee5fd2a616b7
local     e05665e623d7b72a61b9340eea64c5b5b736794e3f13c4decceb8a0580bbd78b
local     immich_model-cache

white bear Sep 11, 2024, 4:47 AM

#

so looks like you database is at ./postgres relative to the docker-compose.yml file'

#

have you made any backup of this database?

warped fog Sep 11, 2024, 4:57 AM

#

white bear so looks like you database is at `./postgres` relative to the `docker-compose.ym...

Correct

warped fog Sep 11, 2024, 4:57 AM

#

white bear have you made any backup of this database?

No. No backup.

white bear Sep 11, 2024, 5:02 AM

#

Do you know what have you changed in the docker-compose.yml file?

warped fog Sep 11, 2024, 5:03 AM

#

white bear Do you know what have you changed in the docker-compose.yml file?

Do you see the two .yml files that I uploaded with the original post. I can do a diff fort you if needed.

white bear Sep 11, 2024, 5:04 AM

#

yes please, that would be helpful

warped fog Sep 11, 2024, 5:06 AM

#

original

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends:
    #   file: hwaccel.transcoding.yml
    #   service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    volumes:
      # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    ports:
      - 2283:3001

#

attempt

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    volumes:
      # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
      # Mount SSL certificate and key from Certbot
      - /etc/letsencrypt/live/photos.nacnud.com/fullchain.pem:/etc/letsencrypt/live/photos.nacnud.com/fullchain.pem:ro
      - /etc/letsencrypt/live/photos.nacnud.com/privkey.pem:/etc/letsencrypt/live/photos.nacnud.com/privkey.pem:ro
      - /etc/letsencrypt/options-ssl-nginx.conf:/etc/letsencrypt/options-ssl-nginx.conf:ro
    env_file:
      - .env
    ports:
      - 443:443  # HTTPS port
      - 2283:3001  # Additional Immich port if needed

#

I reverted back to the original when the attempt didn't work.

white bear Sep 11, 2024, 5:07 AM

#

I don't see why the database would be reset on this one

#

Do you have any client that you can access to the database?

warped fog Sep 11, 2024, 5:08 AM

#

white bear I don't see why the database would be reset on this one

Me neither.

white bear Sep 11, 2024, 5:08 AM

#

or attaching to the database?

warped fog Sep 11, 2024, 5:08 AM

#

Here's the contents of the postgres folder:

root@DietPi:~/immich-app/postgres# ls -al
total 148
drwx------ 21  999 root             4096 Sep 11 05:32 .
drwxr-xr-x  4 root root             4096 Sep 11 05:32 ..
-rw-------  1  999 systemd-journal     3 Sep  9 01:09 PG_VERSION
drwx------  6  999 systemd-journal  4096 Sep  9 01:09 base
-rw-------  1  999 systemd-journal    44 Sep 11 05:32 current_logfiles
drwx------  2  999 systemd-journal  4096 Sep 11 05:33 global
drwx------  2  999 systemd-journal  4096 Sep 11 05:32 log
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_commit_ts
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_dynshmem
-rw-------  1  999 systemd-journal  4821 Sep  9 01:09 pg_hba.conf
-rw-------  1  999 systemd-journal  1636 Sep  9 01:09 pg_ident.conf
drwx------  4  999 systemd-journal  4096 Sep 11 05:37 pg_logical
drwx------  4  999 systemd-journal  4096 Sep  9 01:09 pg_multixact
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_notify
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_replslot
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_serial
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_snapshots
drwx------  2  999 systemd-journal  4096 Sep 11 05:32 pg_stat
drwx------  2  999 systemd-journal  4096 Sep 11 06:07 pg_stat_tmp
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_subtrans
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_tblspc
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_twophase
drwx------  4  999 systemd-journal  4096 Sep  9 01:09 pg_vectors
drwx------  3  999 systemd-journal  4096 Sep  9 01:19 pg_wal
drwx------  2  999 systemd-journal  4096 Sep  9 01:09 pg_xact
-rw-------  1  999 systemd-journal    88 Sep  9 01:09 postgresql.auto.conf
-rw-------  1  999 systemd-journal 28835 Sep  9 01:09 postgresql.conf
-rw-------  1  999 systemd-journal   229 Sep 11 05:32 postmaster.opts
-rw-------  1  999 systemd-journal    94 Sep 11 05:32 postmaster.pid

warped fog Sep 11, 2024, 5:09 AM

#

white bear Do you have any client that you can access to the database?

Are you asking if I can try to connect to my immich server?

white bear Sep 11, 2024, 5:09 AM

#

https://immich.app/docs/guides/database-queries

#

warped fog Sep 11, 2024, 5:10 AM

#

white bear or attaching to the database?

Or are you asking if I can connect directly to the databse?

white bear Sep 11, 2024, 5:10 AM

#

can you try this to connecting to the database

warped fog Sep 11, 2024, 5:10 AM

#

white bear can you try this to connecting to the database

Trying it now.

white bear Sep 11, 2024, 5:10 AM

#

let's do some query to checkout a few things

warped fog Sep 11, 2024, 5:15 AM

#

white bear can you try this to connecting to the database

I get this:

:~/immich-app# docker exec -it immich_postgres psql --dbname=immich --username=postgres
psql (14.10 (Debian 14.10-1.pgdg120+1))
Type "help" for help.

immich=#

white bear Sep 11, 2024, 5:15 AM

#

can you do select u.id from users u;

warped fog Sep 11, 2024, 5:16 AM

#

white bear can you do `select u.id from users u;`

immich=# select u.id from users u;
 id 
----
(0 rows)

#

Nothing there.

white bear Sep 11, 2024, 5:17 AM

#

oh man

#

wth happened here

warped fog Sep 11, 2024, 5:18 AM

#

If I need to recreate, I can. I've got the images. I expect trial and error as I test this. I'd love to not lose the db but I can start over.

white bear Sep 11, 2024, 5:19 AM

#

I just don't understand why the database can be altered with your changes?

warped fog Sep 11, 2024, 5:20 AM

#

First, thank you for caring. Second, for making such a great tool.

white bear Sep 11, 2024, 5:20 AM

#

let me bring this up with the team

warped fog Sep 11, 2024, 5:20 AM

#

What logs would be helpful?

white bear Sep 11, 2024, 5:21 AM

#

in case there are something wrong from us

warped fog Sep 11, 2024, 5:21 AM

#

white bear let me bring this up with the team

Understood. I'll do nothing on this end.

white bear Sep 11, 2024, 5:21 AM

#

can you share the logs just for documentation purposes?

warped fog Sep 11, 2024, 5:21 AM

#

Sure. Where are they located?

white bear Sep 11, 2024, 5:21 AM

#

and the systemy you are running on

warped fog Sep 11, 2024, 5:22 AM

#

Running DietPi (OS) on Raspberry Pi 5.

white bear Sep 11, 2024, 5:23 AM

#

the database is on the local disk, correct?

warped fog Sep 11, 2024, 5:23 AM

#

white bear the database is on the local disk, correct?

Yes. Default install.

white bear Sep 11, 2024, 5:24 AM

#

Thanks

warped fog Sep 11, 2024, 5:25 AM

#

Where are the logs located that you mentioned?

white bear Sep 11, 2024, 5:44 AM

#

you can do docker compose up which will print out the logs of all the conatiners in real time

warped fog Sep 11, 2024, 5:49 AM

#

white bear you can do `docker compose up` which will print out the logs of all the conatine...

I've listed it here:

https://pastebin.com/h4YiqhdL

I don't see anything special.

Pastebin

root@DietPi:~/immich-app# docker compose up[+] Running 5/5 ✔ Networ...

Pastebin.com is the number one paste tool since 2002. Pastebin is a website where you can store text online for a set period of time.

white bear Sep 11, 2024, 5:52 AM

#

I don’t see anything abnormal, unless there was something happened on the system. If you can think of any, please let us know. I also wonder if you can reproduce this

#

From stock settings to your custom settings

warped fog Sep 11, 2024, 6:02 AM

#

white bear I don’t see anything abnormal, unless there was something happened on the system...

I will start over from zero with a small set of images and try to follow the same steps and report back if I can.

white bear Sep 11, 2024, 6:04 AM

#

Thanks Jeffrey

#

It will be helpful

rare cradle Sep 11, 2024, 8:15 AM

#

Hey, is it possible the external drive where the DB is on wasn't properly mounted initially?

#

(I'm assuming it is properly mounted now as you could show the content of the postgres folder)

vapid stump Sep 11, 2024, 12:13 PM

#

Can you give a rough timeline of:

when you installed immich
if you have done any immich upgrades
when you did the "attempt"

warped fog Sep 11, 2024, 2:09 PM

#

rare cradle Hey, is it possible the external drive where the DB is on wasn't properly mounte...

Anything is possible, although I had been reading and writing from/to it daily for over a week.

warped fog Sep 11, 2024, 2:14 PM

#

vapid stump Can you give a rough timeline of: - when you installed immich - if you have do...

First installed immich (v1.113.2) on my laptop on 1Sep2024 setting the upload folder to be an external SSD.
From there I was using it daily to import my google photos takeout library using immich-go.
On 8Sep2024 my raspberry pi 5 arrived and I installed immich (v1.114.0) on it and plugged the SSD into the Pi and continued using it from there.

steep turret Sep 11, 2024, 2:32 PM

#

Seems very likely this is related to the external storage in some way. Possibly unmounted etc

#

Postgres doesn’t just lose the entire DB

vapid stump Sep 11, 2024, 2:57 PM

#

warped fog First installed immich (v1.113.2) on my laptop on 1Sep2024 setting the upload fo...

do you mean september 8th? because otherwise you went back in time to install 1.114

#

when was your "attempt" was that sometime after the 8th or after successfully migrating to the pi 5? did you ever successfully start up immich on the pi and see your existing photos, etc.?

warped fog Sep 11, 2024, 3:21 PM

#

vapid stump do you mean september 8th? because otherwise you went back in time to install 1....

Yes. Thank you.

vapid stump Sep 11, 2024, 3:24 PM

#

changing what folder your docker-compose.yml file was in, especially relative to the postgres folder would create a new database. worth double checking you don't have another postgres/ folder somewhere else on the drive.

warped fog Sep 11, 2024, 4:02 PM

#

vapid stump when was your "attempt" was that sometime after the 8th or after successfully mi...

Yes, I started it up on the pi and everything worked fine. I had been working with the external SSD on the laptop and when I plugged in that same SSD to the pi, it was business as usual.

vapid stump Sep 11, 2024, 4:12 PM

#

Might be worth shutting everything down, plugging the ssd back in, and then starting up immich again.

warped fog Sep 11, 2024, 4:13 PM

#

vapid stump Might be worth shutting everything down, plugging the ssd back in, and then star...

Thank you. It's worth a try.

warped fog Sep 11, 2024, 4:48 PM

#

On my pi, I have an immich-app folder on the microsd card which is 916MB. (clearly the db is still there)
On the external SSD (where the images are stored) there is a postgres folder that is empty.

root@DietPi:/mnt/ssd/immich# ls
docker-compose.yml
encoded-video 19GB)
library (143GB)
postgres (empty)
thumbs (22GB)
upload (8.1GB)

root@DietPi:~/immich-app# ls
docker-compose.yml
docker-compose.yml.bak
docker-compose.yml.org
library
postgres (916MB)

(I don't know why I have it in two places, but I do). Think there might still be a chance to recover this?

vapid stump Sep 11, 2024, 4:50 PM

#

you can probably run docker compose up in ~/immich-app and it will just work.

#

the problem is you are most likely running docker compose up in /mnt/ssd/immich

#

you can't just randomly copy files to different places, run the same command and expect things to work the same way.

warped fog Sep 11, 2024, 4:52 PM

#

vapid stump you can't just randomly copy files to different places, run the same command and...

Yep. I'm old enough to know better, but still, here I am... Thank you.

#

When I run docker-compose up in the immich-app folder, it works but doesn't connect to the existing db.

vapid stump Sep 11, 2024, 4:54 PM

#

The docker-compose.yml has a reference to .env and that needs to exist in the same folder as docker-compose.yml.

.env has references to

UPLOAD_LOCATION=./library
DB_DATA_LOCATION=./postgres

Both of those are local paths, relative to the location of docker-compose.yml so the library and postgres folder needs to exist relative to that.

#

You should just change UPLOAD_LOCATION to /mnt/ssd/immich

warped fog Sep 11, 2024, 4:54 PM

#

on ssd (immich folder)

.env
# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library
# The location where your database files are stored
DB_DATA_LOCATION=./postgres

# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
# TZ=Etc/UTC

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
# Please use only the characters `A-Za-z0-9`, without special characters or spaces
DB_PASSWORD=postgres

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

-----

on pi (immich-app folder)

.env
# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library
# The location where your database files are stored
DB_DATA_LOCATION=./postgres

# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
# TZ=Etc/UTC

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
# Please use only the characters `A-Za-z0-9`, without special characters or spaces
DB_PASSWORD=Y2NjNzQ2YT

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

vapid stump Sep 11, 2024, 4:56 PM

#

I would just set UPLOAD_LOCATION to /mnt/ssd/immich and DB_LOCATION to ~/immich-app/postgres (but probably convert to full, absolute path)

steep turret Sep 11, 2024, 5:01 PM

#

But actually please don’t run your DB on a micro SD😭

#

Not a today problem maybe

warped fog Sep 11, 2024, 5:01 PM

#

steep turret But actually please don’t run your DB on a micro SD😭

Correct. Once I get this going, I'll move it.

warped fog Sep 11, 2024, 5:05 PM

#

vapid stump I would just set UPLOAD_LOCATION to `/mnt/ssd/immich` and DB_LOCATION to `~/immi...

That got me in, back to where I can see all my stuff.

#

Thank you. Can I buy you a coffee, or more? Or just contribute to the project?

wanton palmBOT Sep 11, 2024, 5:09 PM

#

https://buy.immich.app/

vapid stump Sep 11, 2024, 5:09 PM

#

😁

warped fog Sep 11, 2024, 5:10 PM

#

Can I safely copy the db folder over to my ssd?

vapid stump Sep 11, 2024, 5:10 PM

#

If the database container is not running

warped fog Sep 11, 2024, 5:12 PM

#

cp -a postgres/ /mnt/ssd/

That says "failed to preserve ownership..."

steep turret Sep 11, 2024, 5:13 PM

#

What’s the filesystem on the ssd?

warped fog Sep 11, 2024, 5:13 PM

#

wanton palm https://buy.immich.app/

Done.

warped fog Sep 11, 2024, 5:14 PM

#

steep turret What’s the filesystem on the ssd?

Fat32 (for now)

steep turret Sep 11, 2024, 5:14 PM

#

Ah. That won’t work

#

NTFS or FAT isn’t supported for Postgres
I recommend EXT4

warped fog Sep 11, 2024, 5:15 PM

#

steep turret NTFS or FAT isn’t supported for Postgres I recommend EXT4

It was an initial test (on macos) and then moved over to Pi. I'll backup and reformat to EXT4.

#I still have my database in the postgres folder but when I launch immich, it asks me to create admin

References

Checklist