pipeline trigger issue | GitLab Community | Page 1

fluid bay Mar 12, 2024, 1:26 PM

#

Hi all,
I'm having the issue, that for about 3 weeks(~15.02.24), gitlab pipelines are not triggered automatically anymore.
Manually triggered pipelines still work as expected and run.
I've put the longish message into a pastebin: https://pastebin.com/m8nWvXXq

Pastebin

{"severity":"WARN","time":"2024-03-12T13:15:07.236Z","retry":3,"que...

Pastebin.com is the number one paste tool since 2002. Pastebin is a website where you can store text online for a set period of time.

steel hatch Mar 12, 2024, 4:02 PM

#

"ActiveRecord::NotNullViolation","exception.message":"PG::NotNullViolation: ERROR:  null value in column \"partition_id\" of relation \"ci_pipelines_config\" violates not-null constraint\nDETAIL:  Failing row contains (22369, ---\ninclude:\n- local: \".gitlab-ci.yml\"\n, null).\n","exception.backtrace":

This is the error I would be concerned about, did you do any maintenance on your Postgres Database? Even minimal maintenance?

fluid bay Mar 12, 2024, 4:37 PM

#

I did a gitlab-ctl pg-upgrade yesterday.

#

also all migrations have been successful

#

any other pointers, what you mean by minimal database maintenance? The only other option I see, that I haven't used so far, would be the reindex command of rake.

steel hatch Mar 12, 2024, 5:00 PM

#

can you send that rake command so I can see what it does before I recommend it?

#

By minimal I've seen database corruption occur with pointing to a new patroni leader...

#

but in 20 years of working in IT and with databases i've seen a lot.

fluid bay Mar 12, 2024, 7:47 PM

#

the internal doc says this:

#

rake gitlab:db:reindex # Reindex database without downtime to eliminate bloat

steel hatch Mar 14, 2024, 12:50 AM

#

You could try it and see if that fixes the issue.

fluid bay Mar 14, 2024, 12:50 PM

#

fingers crossed

fluid bay Mar 15, 2024, 2:42 PM

#

gitlab-rake gitlab:db:reindex
This feature (database_reindexing) is currently disabled.

fluid bay Mar 20, 2024, 11:41 AM

#

for reference, I've opened an issue over here: https://gitlab.com/gitlab-org/gitlab/-/issues/450257

GitLab

CI pipelines not triggered on push, but work flawlessly if manually...

Hi all, I'm having the issue, that for about 3 weeks(~15.02.24), gitlab pipelines are not triggered automatically anymore on push events or merge events. Manually triggered pipelines...

fluid bay Mar 20, 2024, 5:14 PM

#

solved by another restart of puma and sidekiq.

#pipeline trigger issue