What do the job statuses mean in practice? | Novu | Page 1

kindred plank Nov 9, 2023, 10:12 AM

#

Could someone please explain what the various job status mean in practice? E.g. pending, queued, delayed?

What is delayed digest job?
What is a pending digest job?
What is a pending in-app job? Sent but unread?
What is a pending trigger?

Is there any documentation I could read about this?

rapid shoal Nov 9, 2023, 10:28 AM

#

<@&943775970421264404> could you please help us here?

dawn plume Nov 9, 2023, 10:32 AM

#

kindred plank Could someone please explain what the various job status mean in practice? E.g. ...

pending digest - actively aggregating messages into one message
pending in-app job - in the process of sending specifically an in-app notification
pending trigger - trigger request was recevied and is awaiting fan-out through topics or getting a set of subscribers

kindred plank Nov 9, 2023, 10:34 AM

#

Thanks @dawn plume. So if I have a lot of pending jobs, how can I speed this up? Adding more workers?

dawn plume Nov 9, 2023, 10:40 AM

#

kindred plank Thanks <@331526439771832322>. So if I have a lot of pending jobs, how can I spee...

If your self-hosting, then yes.
the workers do all of the processing in the trigger flow.

I would also make sure you have AUTO_CREATE_INDEXES=true on all apps that touch the database

glossy orchidBOT Nov 10, 2023, 6:19 AM

#

Issue DVRL-90 created.

DVRL-90 - document job statuses in activity feed page

Status

Triage

kindred plank Nov 11, 2023, 9:38 AM

#

@dawn plume no matter how much resource I put into it, I just end up with tons of pending jobs. I get why if I'm triggering faster than I can process I build up a backlog, but it's running into millions of pending jobs and a tiny few actually get delivered. I've got like millions of in-app pending tasks.

It seems like the trouble is topics with lots of subscribers and a 1 day digest just spends all its time digesting and not delivering

#

Is there a way to run workers that just look for certain statuses? E.g. have a worker processing triggers and one processing pending jobs?

kindred plank Nov 17, 2023, 2:29 PM

#

For posterity: ended up deleting a bunch of old jobs that were stuck. Since upgrading to 0.21, haven't yet seen the same problem

dawn plume Nov 17, 2023, 8:44 PM

#

I am not sure why that way happening. The way the worker works is that they round robin over every topic which is inefficient, this is most likely way it seemed like it was not helping.

#What do the job statuses mean in practice?