#Machine Learning Container on the fritz since v3.3.3 update

1 messages · Page 1 of 1 (latest)

hasty rain
#

Hi all,

Not sure how to format a help-desk-support ticket, but I’ll try to keep it short for starters.

Been running Immich successfully on my NAS with Portainer for about 1-2 years. Usually show off the search function (client-side) to friends, but noticed it wasn’t working the other day while using it.

Re-ran all ML jobs manually, grabbed logs yesterday morning. Despite the logs, Portainer shows all 4 Immich containers “up” and running “healthy”.

Thanks for any help/advice.

frail jacinthBOT
#

:wave: Hey @hasty rain,

Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich immich.

References

#

Checklist

I have...

  1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
  2. :ballot_box_with_check: read applicable release notes.
  3. :ballot_box_with_check: reviewed the FAQs for known issues.
  4. :ballot_box_with_check: reviewed Github for known issues.
  5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
  6. :ballot_box_with_check: uploaded the relevant information (see below).
  7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

Information

In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:

  • Your docker-compose.yml and .env files.
  • Logs from all the containers and their status (see above).
  • All the troubleshooting steps you've tried so far.
  • Any recent changes you've made to Immich or your system.
  • Details about your system (both software/OS and hardware).
  • Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
  • The version of the Immich server, mobile app, and other relevant pieces.
  • Any other information that you think might be relevant.

Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

hasty rain
left hornet
#

The connection to the ML Container doesnt work

#

Post your docker compose file, looks like a wrong port (?)

hasty rain
#

Server env:

#

ML env:

frail jacinthBOT
left hornet
#

According to the log, the Immich server is looking for the ML container on port 3008, but the ML container is actually on port 3003. Have you changed anything?

hasty rain
#

No, nothing - the yml says 3003, right?

left hornet
#

yea but the HOST Ports are only important, when the immich containers are not in the same custom network (by default its immich_default)

hasty rain
#

The only thing I’ve been changing regularly on updates is if I notice a REDIS container change in a new release on GitHub

#

(Or, obv, if the release notes say to change something specifically)

#

Otherwise I’ve been pretty hands-off with the yml.

left hornet
#

Yes, that doesn't matter

You could try removing the containers (you won't lose any files if everything is mapped correctly) and then recreating them, maybe one of the containers is corrupted in some way

hasty rain
#

Yeah, I appreciate that - I might try that when I have time today and report back.

I brought them up and down a bunch yesterday morning, and I was re-pulling images when I did.

#

It’s odd that it would be looking for the ML container at 3008

left hornet
#

In Portainer, all you need to do is click “Stop Stack” and then go to “Images” and delete Immich's images (otherwise, it won't download new ones and will just use the existing ones)

hasty rain
#

Oh yeah, I’m just super tired (around 5 AM Sun my time, lol) - mostly I just wanted to get the ticket in before I procrastinated anymore.

My computer isn’t in front of me atm.

#

Well, I can do it from my phone - one sec

#

Honestly, I suppose I could just comb over everything and my NAS’s firewall and just try changing the ML port to 3008. But I don’t why the server container is looking for it there.

white sage
#

Did you set that as URL in the admin settings @hasty rain ?

hasty rain
#

No sir, but I’ll go check

white sage
#

Are you sure it's port 3008 @left hornet and not just a funny error number coincedence 😛

hasty rain
#

lol, Maybe it's 50:50

white sage
#

pretty sure it's just a coincedence

hasty rain
#

Maybe, maybe not

#

lol

left hornet
white sage
#

The getaddrinfo ENOTFOUND error with errno: -3008 in Node.js indicates that the DNS resolver failed to map the specified hostname to an IP address.

#

Doesn't mean the port is 3008

hasty rain
#

Makes sense to me if it’s a documented error code

#

Just awfully coincidental to be a number so close to the specified port number

white sage
#
    ports:
      - 3003:3003

Did you add that to try and fix it or was it always there?

hasty rain
#

Always been there

white sage
#

Remove that will you

hasty rain
#

That’s how my NAS has always done it

#

Sure, I’ll give it a try

white sage
#

ah NAS mm

hasty rain
#

Or not… lol

white sage
#

Is it Synology?

hasty rain
#

Asustor

white sage
#

Ugh even worse

hasty rain
#

I know, right?

left hornet
#

The ports doesnt matter, when they are on the same custom network ? so shouldnt make a difference ?

white sage
#

Try removing it first, you never know

white sage
hasty rain
#

I go to buy the first NAS in my life, the specs look great, terrible OS. I should have flashed it with something else on day one.

white sage
#

Like with Synology there is a step where you have to allow the server container to reach the ML container or something

left hornet
#

Using a “regular” PC as a server would probably be a better choice than flashing the OS

hasty rain
#

Oh absolutely

white sage
#

I flashed my NAS with regular old Debian

#

Installed proxmox on top

hasty rain
#

But it took me 1-2 years to know you’re right 😄

white sage
#

Now it's a node in my cluster

hasty rain
#

That’s pretty awesome, actually

#

I know we’re getting off-topic, so I’ll stop myself here - but someone on Discord showed me Proxmox about a year or more ago, so I got a mini-PC to try hosting from. It was an incredible learning experience, but I hit a wall at some point and the mini-PC has just been sitting in my office doing nothing since then, lol.

white sage
#

It's your topic you can do whatever you want man

hasty rain
#

Not hosting Immich, but smaller, simpler things

#

Haha, thanks

#

I just think it’s rad you took a NAS and went full Proxmox with it

white sage
#

I faffed around with proxmox at home when I started working on my phd

#

Got me 2 jobs after that

#

also, proxmox is for running LXC scripts with services of course:

hasty rain
#

Yeah - it’s honestly pretty cool

white sage
#

Before we forget: did the port thing work or not? 😛

hasty rain
#

I was trying to setup BunkerWeb on it - maybe I’ll give it a go again sometime this winter. Maybe they’ve fixed some performance issues I was having with my EPUB/CBR/CBZ libraries - BW didn’t play very nice with OPDS back then. Maybe it’s better now.

#

I’ll give it a try, one sec

#

Okay, removed from yml, containers rebooting

#

lol, wow, that might have actually been the trick

white sage
#

Whodathunkit

#

(me, Idathunkit)

spice spindle
hasty rain
#

I feel like I need to re-run the jobs again, but that's better than returning zero results

left hornet
#

portainer = dog peepoNotes

hasty rain
#

Re-running (most, if not all) ML jobs now

#

I’m seeing improooovement. 😄