Error: type "vendorindexinfo" does not exist | Immich | Page 1

next parrot Feb 27, 2024, 12:54 AM

#

I'm currently working to upgrade my immich instance to 1.95.0, but I'm struggling to get my pgvecto.rs instance to upgrade to v0.2.0. Here is my setup:

Currently running Cloudnative pg in kubernetes. I swapped out ghcr.io/bo0tzz/cnpgvecto.rs:14-v0.1.10 for ghcr.io/tensorchord/cloudnative-pgvecto.rs:14.11-v0.2.0. I simply changed the image and commited the changes and CNPG rolled out the changes to my cluster. I then followed the migration steps in the 1.95.0 release notes. When I run ALTER EXTENSION vectors UPDATE TO '0.2.0';, I get an error that says ERROR: type "vectorindexinfo" does not exist. Then running SELECT pgvectors_upgrade(); fails.

Postgresql config for kubernetes: https://github.com/ModestTG/jace-cluster/blob/main/kubernetes/apps/database/cloudnative-pg/cluster/cluster2.yaml

I haven't restarted the PG cluster yet as it requires me to bootstrap from backup. Do I need to do that or potentially stream the database to a new cluster with the new image? Any help is appreciated. Thanks!

Edit: the user that access the immich database is not a super user

tawdry bloomBOT Feb 27, 2024, 12:54 AM

#

:wave: Hey @next parrot,

Thanks for reaching out to us. Please follow the recommended actions below; this will help us be more effective in our support effort and leave more time for building Immich immich .

References

Container Logs: docker compose logs docs
Container Status: docker compose ps docs
Reverse Proxy: https://immich.app/docs/administration/reverse-proxy

Checklist

:ballot_box_with_check: I have verified I'm on the latest release(note that mobile app releases may take some time).
:ballot_box_with_check: I have read applicable release notes.
:ballot_box_with_check: I have reviewed the FAQs for known issues.
:ballot_box_with_check: I have reviewed Github for known issues.
:ballot_box_with_check: I have tried accessing Immich via local ip (without a custom reverse proxy).
:ballot_box_with_check: I have uploaded the relevant logs, docker compose, and .env files using the buttons below or the /upload command.
:ballot_box_with_check: I have tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

If this ticket can be closed you can use the /close command, and re-open it later if needed.

tawdry bloomBOT Feb 27, 2024, 1:14 AM

#

tawdry bloom :wave: Hey <@275439114747248641>, Thanks for reaching out to us. Please follow ...

Successfully submitted, a tag has been added to inform contributors. :white_check_mark:

#

@next parrot uploaded

📎 psql.txt

honest kayak Feb 27, 2024, 1:27 AM

#

I think @ornate leaf ran into something similar

gilded rock Feb 27, 2024, 1:45 AM

#

I've only seen this error in this ticket before and it's the only case we haven't been able to fix #1209797884652949524 message

#

But I don't know if this necessarily means it'll be as problematic for you. You can try the things in that thread and see where it goes

next parrot Feb 27, 2024, 3:12 AM

#

gilded rock I've only seen this error in this ticket before and it's the only case we haven'...

Thanks. I'll keep an eye on it and try some experimenting.

ornate leaf Feb 27, 2024, 7:50 AM

#

I'm not sure if there is an upgrade path from 0.1.10 - 0.2.0

next parrot Feb 27, 2024, 1:24 PM

#

Is it not possible to stream the data into a new CNPG instance with 0.2.0 installed? Or do you have to alter the tables still to make it work?

next parrot Feb 27, 2024, 8:13 PM

#

This might be a dumb question, but what would I lose if I just scrapped my DB and started over. All of the picture originals are there. It would just be all of the ancillary stuff (users, faces, albums, etc.). Obviously I'd like to avoid this but at least for myself I could rebuild all of that, even though it would be very annoying.

#

When you assign a date from the Immich UI, does that actually update the exifdata on the image or just in the DB?

ornate leaf Feb 27, 2024, 8:15 PM

#

next parrot Is it not possible to stream the data into a new CNPG instance with 0.2.0 instal...

You could try dropping the vectors extension, upgrading to 0.2.0, then creating it again and rebuilding the indexes with the steps at https://github.com/immich-app/immich/discussions/7381#discussioncomment-8573375

#

I don't think you would need tos tream into a new instance for that

ornate leaf Feb 27, 2024, 8:15 PM

#

next parrot When you assign a date from the Immich UI, does that actually update the exifdat...

It should create a .xmp sidecar file next to the original

next parrot Feb 29, 2024, 8:43 PM

#

ornate leaf You could try dropping the vectors extension, upgrading to 0.2.0, then creating ...

@ornate leaf does my immich database tables need to have the vectors schema? Mine is currently set to public and I'm getting errors when rebuilding the indices

ornate leaf Feb 29, 2024, 8:46 PM

#

Yes, the steps from the release notes include creating that schema

next parrot Feb 29, 2024, 8:53 PM

#

Right. I created the schema but they aren't listed for the tables in the database.

#

So the schema is listed there but it's not in the "schema" for the actual tables. Not sure if that's an issue because it looks like my instance was upgraded and potentially working maybe kind of sort of nobody breathe?

ornate leaf Feb 29, 2024, 8:56 PM

#

I -think- vecto.rs will create a view in the vectors schema that would show up there? But @gilded rock will know for sure

#

If everything is working including CLIP/faces then I would just call it a day :P

next parrot Feb 29, 2024, 9:00 PM

#

Steps I took:

Revert to image ghcr.io/bo0tzz/cnpgvecto.rs:14-v0.0.10 (image before upgrade)
DROP EXTENSION IF EXISTS vectors;
upgrade image to ghcr.io/tensorchord/cloudnative-pgvecto.rs:14.11-v0.2.0
follow reindexing steps https://github.com/immich-app/immich/discussions/7381#discussioncomment-8573375

next parrot Feb 29, 2024, 9:01 PM

#

ornate leaf If everything is working including CLIP/faces then I would just call it a day :P

How would I test this real quick to ensure it's working?

ornate leaf Feb 29, 2024, 9:01 PM

#

For CLIP just do a context search and see if things explode

#

For faces the easiest is probably to just upload a new image with a face in it

gilded rock Feb 29, 2024, 9:04 PM

#

The vectors schema is just for the extension. immich tables will still be public

next parrot Feb 29, 2024, 9:06 PM

#

So I just uploaded a selfie and got these errors. These seem consistent with the errors I saw when trying to reindex the database

gilded rock Feb 29, 2024, 9:08 PM

#

You probably ran DROP EXTENSION vectors CASCADE. I wish Postgres didn’t suggest that…

next parrot Feb 29, 2024, 9:08 PM

#

I did 😦

#

Any remedy for that or no?

gilded rock Feb 29, 2024, 9:10 PM

#

You can try this https://github.com/immich-app/immich/discussions/7310#discussioncomment-8559595

next parrot Feb 29, 2024, 9:14 PM

#

gilded rock You can try this https://github.com/immich-app/immich/discussions/7310#discussio...

Thanks! How do I know if I'm using the default CLIP model? If I have to ask I assume I am 😄

gilded rock Feb 29, 2024, 9:15 PM

#

Haha yeah you’re fine

#

The model you’re using is shown in the admin settings, but if you didn’t touch it then no need to worry about it

next parrot Feb 29, 2024, 9:21 PM

#

I'm running into the same issue that Foritus on github ran into where I'm getting a permission issue when I run CREATE INDEX IF NOT EXISTS clip_index ON smart_search USING hnsw (embedding vector_cosine_ops) WITH (ef_construction = 300, m = 16);. I tried ALTER EXTENSION vectors OWNER TO pg_database_owner but that didn't work. I'm not sure what piece of software he was using to manage his postgres instance.

https://github.com/immich-app/immich/discussions/7381#discussioncomment-8573375

#

I got that fixed. Needed to change the schema not the extension. Once I got that fixed I reran the SQL and got this.

#

Do I now need to run the upgrade commands from that link do you think @gilded rock?

#

I get no rows returned from the pgvectors upgrade instructions. Not sure how to delete all index files. Maybe they're already deleted and everything is empty and I'm good to go?

gilded rock Feb 29, 2024, 9:44 PM

#

https://github.com/immich-app/immich/discussions/7381#discussioncomment-8573375

next parrot Feb 29, 2024, 9:52 PM

#

gilded rock https://github.com/immich-app/immich/discussions/7381#discussioncomment-8573375

Right. When I try those commands I get ERROR: pgvecto.rs: the extension is upgraded so all index files are outdated. ADVICE: Delete all index files. Please read .... When I try DROP INDEX IF EXISTS clip_index, that index doesn't exist so it skips it.

#

So it's telling me both that I don't have any index files, but also that the extension is upgraded an all index files are outdated and need to be deleted.

#

gilded rock Feb 29, 2024, 9:56 PM

#

Try running SELECT pgvectors_upgrade(); and restarting

next parrot Feb 29, 2024, 10:03 PM

#

I brought down my cluster and brought it back up. I got the same results.

#

I imagine clip_index and face_index need to be in here right?

next parrot Feb 29, 2024, 10:46 PM

#

Well I feel like I'm getting somewhere. I tried restarting postgresql (brought down all 3 instances of CNPG and brought back up). Still seeing this:

#Error: type "vendorindexinfo" does not exist

References

Checklist