Messed up the upgrade, don't know what to do now | authentik | Page 1

past sentinel Jun 27, 2024, 1:37 AM

#

So I was on 2024.2.4 and when the security update was issued I figured it was time to move to a newer version. But I somehow missed the note about needing to migrate to a newer version of postgres before. I did the update without properly migrating postgres and got errors from that container and others.

Then I made possibly dumb decision #2 which is that I decided to just roll back to 2024.2.4.

All of the containers start up just fine now, but when I try to login to the Authentik admin panel I get the default login screen background but a long error in the browser window.

#

here is the error...

#

📎 message.txt

static gyro Jun 27, 2024, 2:21 AM

#

@past sentinel can you post a screenshot of the error instead of the html page

past sentinel Jun 27, 2024, 2:21 AM

#

Screenshot_2024-06-26_at_10.21.39_PM.png

static gyro Jun 27, 2024, 2:22 AM

#

ok so that's shown in body

#

before doing anything backup your db

#

and do docker logs <postgres container> and logs for server container

past sentinel Jun 27, 2024, 2:24 AM

#

static gyro before doing anything backup your db

okay i gotta figure out how to do that real quick

#

it's not bind mounted so i'm a little confused

static gyro Jun 27, 2024, 2:24 AM

#

is it the default docker compose

#

if so docker volume create authentik_database_backup && docker run --rm -v authentik_database:/from -v authentik_database_backup:/to alpine sh -c 'cd /from && cp -a . /to'

#

docker volume ls to get volume name

past sentinel Jun 27, 2024, 2:26 AM

#

yep okay just did that

static gyro Jun 27, 2024, 2:26 AM

#

ok so now can u send server and postgres logs

past sentinel Jun 27, 2024, 2:27 AM

#

📎 authentik-postgresql-1_logs.txt

#

sorry the log file for server is massive

static gyro Jun 27, 2024, 2:28 AM

#

and rq out of curiosity do u have anything important on your instance

past sentinel Jun 27, 2024, 2:28 AM

#

what do you mean

static gyro Jun 27, 2024, 2:28 AM

#

like how much stuff do you have on it

#

is it a fresh one

past sentinel Jun 27, 2024, 2:29 AM

#

just radarr, sonarr, etc

static gyro Jun 27, 2024, 2:29 AM

#

try upgrading to 2024.4.2 then rebuild stack with --build and --force-recreate

#

might fix the relation does not exist

past sentinel Jun 27, 2024, 2:30 AM

#

so just wget -O docker-compose.yml https://goauthentik.io/version/2024.4/docker-compose.yml docker compose up -d

#

or i need to add those flags?

static gyro Jun 27, 2024, 2:31 AM

#

add those flags

#

to ensure the containers start from fresh

past sentinel Jun 27, 2024, 2:32 AM

#

sorry i'm pretty new at this... docker compose up -d -build --force-recreate

#

does that look right?

static gyro Jun 27, 2024, 2:32 AM

#

docker compose up --build --force-recreate

#

don't add -d so you can see logs in realtime

past sentinel Jun 27, 2024, 2:32 AM

#

ok

static gyro Jun 27, 2024, 2:33 AM

#

tell me if you see migrations being applied

past sentinel Jun 27, 2024, 2:33 AM

#

i saw "applying django migration" fly by

static gyro Jun 27, 2024, 2:34 AM

#

what do you see below

past sentinel Jun 27, 2024, 2:34 AM

#

there's so much

static gyro Jun 27, 2024, 2:34 AM

#

does it say something like migrations are being applied

#

or files like 000X_something i don't remember migration file format for this

past sentinel Jun 27, 2024, 2:35 AM

#

Screenshot_2024-06-26_at_10.35.41_PM.png

static gyro Jun 27, 2024, 2:35 AM

#

anyways give it a sec and try going back to the web page and see what's happening

static gyro Jun 27, 2024, 2:36 AM

#

past sentinel

anything below?

past sentinel Jun 27, 2024, 2:37 AM

#

Screenshot_2024-06-26_at_10.37.15_PM.png

#

there's so many lines so i'm not totally sure what to send you

#

but lemme try the login page again

static gyro Jun 27, 2024, 2:38 AM

#

doesn't seem to be any errors on this screenshot so that's good

past sentinel Jun 27, 2024, 2:38 AM

#

IT WORKED

#

i'm in

static gyro Jun 27, 2024, 2:38 AM

#

ok cool so yea

past sentinel Jun 27, 2024, 2:38 AM

#

ah okay

static gyro Jun 27, 2024, 2:38 AM

#

do you need help with the postgres upgrade?

past sentinel Jun 27, 2024, 2:39 AM

#

i think ill stay on this version for now

#

i appreciate the offer but this edible just kicked in

static gyro Jun 27, 2024, 2:39 AM

#

several security issues are fixed

#

but this edible just kicked in

lol

past sentinel Jun 27, 2024, 2:39 AM

#

ah shit, maybe i should try

static gyro Jun 27, 2024, 2:40 AM

#

docs should be pretty straightforward. go one step at a time

past sentinel Jun 27, 2024, 2:40 AM

#

i'm confused though

#

i thought new versions of 2024.2 and 2024.4 were also released to address the security issues?

static gyro Jun 27, 2024, 2:40 AM

#

no

#

just backports

past sentinel Jun 27, 2024, 2:40 AM

#

ohh

#

i was doing this from macos terminal

#

i just closed it

static gyro Jun 27, 2024, 2:42 AM

#

oh k

past sentinel Jun 27, 2024, 2:42 AM

#

okay lemme see if i can figure out the postgres upgrade while i've got you

static gyro Jun 27, 2024, 2:43 AM

#

kk

past sentinel Jun 27, 2024, 2:43 AM

#

https://docs.goauthentik.io/docs/troubleshooting/postgres/upgrade_docker

Upgrade PostgreSQL on Docker Compose | authentik

Dump your database

#

just follow this step by step?

static gyro Jun 27, 2024, 2:43 AM

#

yea

#

fun fact: i made the pr to upd pg version

past sentinel Jun 27, 2024, 2:44 AM

#

oh nice

static gyro Jun 27, 2024, 2:44 AM

#

~~tana has been ghosting me in my latest prs tho 😢~~

past sentinel Jun 27, 2024, 2:45 AM

#

so i guess the first step is intimidating me slightly

static gyro Jun 27, 2024, 2:45 AM

#

for a second i taught it as her 🤣

past sentinel Jun 27, 2024, 2:45 AM

#

i just dump my database?

static gyro Jun 27, 2024, 2:45 AM

#

after you stop the stack yea

past sentinel Jun 27, 2024, 2:47 AM

#

service "postgresql" is not running container #1

#

i don't get it 😦

static gyro Jun 27, 2024, 2:48 AM

#

docker ps

#

take the name for the postgres container

past sentinel Jun 27, 2024, 2:49 AM

#

it's not listed

#

but i can see it in portainer

#

authentik-postgresql-1

static gyro Jun 27, 2024, 2:50 AM

#

yea so use that from now on

#

i think there are like 3 different postgres container names across the page so lol

past sentinel Jun 27, 2024, 2:51 AM

#

service "authentik-postgresql-1" is not running container #1

static gyro Jun 27, 2024, 2:51 AM

#

do without the -1

past sentinel Jun 27, 2024, 2:53 AM

#

same response

#

wait do i need to put sudo first

static gyro Jun 27, 2024, 2:53 AM

#

goddammit

#

run docker ps rq

past sentinel Jun 27, 2024, 2:54 AM

#

"docker ps" accepts no arguments.
See 'docker ps --help'.

static gyro Jun 27, 2024, 2:54 AM

#

rq = real quick

#

mb

past sentinel Jun 27, 2024, 2:54 AM

#

lol oh

static gyro Jun 27, 2024, 2:54 AM

#

lol

past sentinel Jun 27, 2024, 2:55 AM

#

i don't see any of the authentik containers listed

#

i can see them all in Portainer though

static gyro Jun 27, 2024, 2:55 AM

#

mmm

past sentinel Jun 27, 2024, 2:55 AM

#

all of my other running containers are listed

static gyro Jun 27, 2024, 2:55 AM

#

did you stop the containers

past sentinel Jun 27, 2024, 2:55 AM

#

yes

static gyro Jun 27, 2024, 2:56 AM

#

#

docker compose up -d

#

dump commands

#

docker compose down

past sentinel Jun 27, 2024, 2:56 AM

#

ohhh i thought you told me to stop them

#

sorry my bad

static gyro Jun 27, 2024, 2:56 AM

#

all good

past sentinel Jun 27, 2024, 2:59 AM

#

docker volume create authentik_database_backup && docker run --rm -v authentik_database:/from -v authentik_database_backup:/to alpine sh -c 'cd /from && cp -a . /to'

#

do i need to do this step again?

#

since i just did it earlier?

#

if yes, should i change the backup destination volume name?

static gyro Jun 27, 2024, 3:00 AM

#

past sentinel if yes, should i change the backup destination volume name?

yea do it again and change name

#

cause you ran those commands remember? better be safe and take the latest .sql

past sentinel Jun 27, 2024, 3:01 AM

#

docker volume create authentik_database_backup2 && docker run --rm -v authentik_database:/from -v authentik_database_backup2:/to alpine sh -c 'cd /from && cp -a . /to'

#

so can just add 2 after the volume name?

static gyro Jun 27, 2024, 3:01 AM

#

if you want

past sentinel Jun 27, 2024, 3:06 AM

#

okay i changed the postgres image number to 16 in the docker compose

#

but where do i add network mode: none

#

like is there a specific line?

static gyro Jun 27, 2024, 3:07 AM

#

past sentinel but where do i add network mode: none

anywhere indented like other things

#

just add it under image

past sentinel Jun 27, 2024, 3:08 AM

#

Screenshot_2024-06-26_at_11.08.41_PM.png

static gyro Jun 27, 2024, 3:08 AM

#

yea

past sentinel Jun 27, 2024, 3:08 AM

#

why did it turn greener?

static gyro Jun 27, 2024, 3:09 AM

#

no reason

#

from what i can see

past sentinel Jun 27, 2024, 3:10 AM

#

[+] Pulling 4/4
✔ server Skipped - Image is already being pulled by worker 0.0s
✔ worker Pulled 0.5s
✔ redis Pulled 0.5s
✔ postgresql Pulled

#

✔ Network authentik_default Created 0.1s
✔ Volume "authentik_database" Created 0.0s
✔ Container authentik-postgresql-1 Started

#

is that normal that it skipped server?

static gyro Jun 27, 2024, 3:11 AM

#

yea

#

in your command you only specified postgres

past sentinel Jun 27, 2024, 3:12 AM

#

ah yeah

#

just copied from the instructions

#

okay starting them all up again

#

fingers crossed

#

all healthy!

static gyro Jun 27, 2024, 3:14 AM

#

did you apply your .sql?

past sentinel Jun 27, 2024, 3:14 AM

#

yeah

static gyro Jun 27, 2024, 3:14 AM

#

and remove network mode none?

past sentinel Jun 27, 2024, 3:14 AM

#

i did all the steps

static gyro Jun 27, 2024, 3:14 AM

#

and upgrade server and worker to 2024.6.0?

past sentinel Jun 27, 2024, 3:14 AM

#

just didn't say anything unless i was confused

#

i have not upgraded to 2024.6 yet though

static gyro Jun 27, 2024, 3:15 AM

#

k

#

that step should be pretty easy

past sentinel Jun 27, 2024, 3:15 AM

#

yeah lemme try now

#

seems to all be working!

#

thanks so much!

#

now ill just test that it's working with NGINX properly

static gyro Jun 27, 2024, 3:18 AM

#

no problem

#

do you run plain nginx or something like nginx proxy manager?

past sentinel Jun 27, 2024, 3:23 AM

#

proxy manager

#

looks like everything is working!

#

thanks again

#Messed up the upgrade, don't know what to do now