#Nothing to see here.

1 messages · Page 1 of 1 (latest)

gentle shoreBOT
#

:wave: Hey @tight heart,

Thanks for reaching out to us. Please follow the recommended actions below; this will help us be more effective in our support effort and leave more time for building Immich immich.

References

Checklist

  1. :ballot_box_with_check: I have verified I'm on the latest release(note that mobile app releases may take some time).
  2. :ballot_box_with_check: I have read applicable release notes.
  3. :ballot_box_with_check: I have reviewed the FAQs for known issues.
  4. :ballot_box_with_check: I have reviewed Github for known issues.
  5. :ballot_box_with_check: I have tried accessing Immich via local ip (without a custom reverse proxy).
  6. :ballot_box_with_check: I have uploaded the relevant logs, docker compose, and .env files using the buttons below or the /upload command.
  7. :blue_square: I have tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

gentle shoreBOT
flint pawn
#

Can you post some detail like actual errors and such?

#

reminiscent of a locked db trying to be accessed by Java
This doesn't really make much sense in this context - there is no db that could end up 'locked', and no Java involved either

#

cc @snow tartan

tight heart
#

and, yeah, it started yesterday on another thread. ill link to that after this.

flint pawn
#

Connection terminated due to connection timeout
This is Immich losing the connection to Postgres. Usually that's a symptom of your system being overloaded and the Postgres database not managing to keep up.

tight heart
#

thats from server

#

heres postgres

#

yeah, i know where its coming from

#

oh, so not locked, just lagging?

#

im not real worried about my machine, these are all slop machines thrown together for testing to see if i could cause them to go bork

#

it seems to require a certain threshold to be crossed (guessing just sheer number of files) as i can hard kill the transfer if its only transfered a couple hundred or thousand files. when it gets in the hundreds of thousands, and gets a hard kill, immich cant recover from it. or, it can, but is kind of crippled-ish

flint pawn
#

Try setting the concurrency for all the jobs to 1 and then see if it still happens

#

It's probably just getting overloaded

tight heart
#

ill give it a shot, but, this doesnt happen unless theres a hard kill. i can queue up 500k files and dump them just fine

#

and, im not really trying to fix this, more bringing attention to its replicapability

#

ok, ive got a box running, dumping 1.4M files. ill hard kill its network around the 500k mark. additionally, ive got all processes running at 1 concurrency

#

gimme about 10 hours to get back to this (probably wont be til tomorrow though to be honest..)

#

nm, i can recreate in 5k files with a single concurrency.

2024-01-16 16:20:19.194 UTC [188] ERROR: duplicate key value violates unique constraint "UQ_assets_owner_library_checksum"

flint pawn
#

That message isn't necessarily a problem, it just means there was an attempt to upload a duplicate asset

#

The issue I was looking at is the overloading/database timeouts ;)

tight heart
#

im not sure i agree. about the "not necessarily a problem".

#

heres a wider view of that error in the context of the logs.

tight heart
#

i retract my former statement. It doies seem to not matter, the immich-go dump does pick up after a few minutes. Ill see if i can replicate on other machines seeing a similar issue with larger batches

📎 message.txt
snow tartan
#

I do interrupt immich-go without precaution when doing test. I haven't seen any problem. And renning again the same command will continue the job.

tight heart
snow tartan
#

When breaking immich-go all connections are closed... Nothing special. I have used immich-go for my own photo collection with 100k files. Some users reported having uploaded much more

tight heart
#

well then, guess my ability to replicate means sjhit. cool. lets go ahead and close this.