#Meilisearch CPU usage

1 messages · Page 1 of 1 (latest)

barren wharf
#

Noticing this process that never goes away singe upgrading to 1.0+ It's always sitting at 10.8%, never goes away? If tunarr is restarted, it comes back as well. Is it actually consuming more CPU? It's partly been observed as overall I'm feeling more performance concerns, but can't yet attribute a cause or if related to Tunarr, but have noticed this new process consistently showing up that did not previously.

Command
/tunarr/bin/meilisearch --http-addr localhost:40475 --db-path /config/tunarr/data.ms --no-analytics --experimental-dumpless-upgrade --schedule-snapshot 240 --snapshot-dir /config/tunarr/ms-snapshots --experimental-reduce-indexing-memory-usage
ID
243095
Parent process
/tunarr/tunarr server
Owner
root
CPU
10.8 %
Size
967.05 MiB
Run time
02:43:46

lost sky
#

The search index shouldn’t really be doing any work unless indexing is happening, which by default only happens every 6 hours

#

If you measure while it’s indexing that could be part of it. Initial indexing of libraries will take longer than subsequent indexes. Perhaps that is why it seems persistent

#

In general indexing is memory heavy but it ofc has a cpu impact as well. But just running the index without adding it to or querying it should theoretically run very lightly

barren wharf
#

Don't see any ongoing activity in the debug logs (if they are in the same place) and it's been consistently there since upgrading yesterday -- and always 10.8 -- just odd

lost sky
#

Definitely strange. I imagine there would be some latent overhead but that seems excessive if there’s no activity and is not something I’ve personally observed. I will probably have to add an option to see debug logs on the search several times so we know what is going on

barren wharf
#

Rgr, just yeah -- I don't know what it's doing. If it's doing anything, but even now it sits at 10.8 and never budges from that measure. THings don't seem to be problematic, and even changing the logs to trace doesn't indicate search activity. Just see some cc srt stuff, and in the last few minutes only activity is related to an ongoing stream session.

I don't use the smart collections (yet). Libraries last sync'd over an hour ago and don't indicate anything active.

#

Though odd, the subtitle extraction task has been running for 40 minutes....

#

But i've not really had the need to watch it or how long it may have taken in the past...

lost sky
#

i need to enable a way to see the meilisearch logs at finer levels so in situations like these we can see what it is doing

#

if anything, i cant imagine it is much without tunarr interacting with it

barren wharf
#

I worked through my performance issues, was really unrelated but a cable apparently went bad to the server, which slowed everything to a crawl communicating with the NAS and elsewhere and anything and everything dependent on it.

That said, while I'm not really feeling it, the process remains but reduced to 9.7/9.8 throughout today. Everytime I look in on it, it's there. Including after a few restarts of the server and container.

Command
/tunarr/bin/meilisearch --http-addr localhost:37485 --db-path /config/tunarr/data.ms --no-analytics --experimental-dumpless-upgrade --schedule-snapshot 240 --snapshot-dir /config/tunarr/ms-snapshots --experimental-reduce-indexing-memory-usage
ID
2177565
Parent process
/tunarr/tunarr server
Owner
root
CPU
9.7 %
Size
495.51 MiB
Run time
01:13:53

So can't say any current issue to dig into, but just noting the observation.

#

The long running subtitle extraction likely was related to the cable/performance issue.

lost sky
#

looking at the MS process in my docker deploy of Tunarr and it's sitting at 0% 🤔

barren wharf
#

No issue, Just updating, Still present despite restarts -- at 9.6%. (Watchtower updates near nightly if a new release to grab).

Command
/tunarr/bin/meilisearch --http-addr localhost:38199 --db-path /config/tunarr/data.ms --no-analytics --experimental-dumpless-upgrade --schedule-snapshot 240 --snapshot-dir /config/tunarr/ms-snapshots --experimental-reduce-indexing-memory-usage
ID
3486714
Parent process
/tunarr/tunarr server
Owner
root
CPU
9.6 %
Size
530.36 MiB
Run time
02:50:45

lost sky
#

i think the fact that it is static at 9.6% is pretty odd

#

never seen a process so consistent

barren wharf
#

Yeah, not sure if dealing with stale data/reporting or what. Other processes are shifting, just not this one.

#

Though on full reboot/cycle it returns.

lost sky
#

how are you pulling the numbers?