Best System monitoring app/add-on?

[icy harbor]

Noticing this odd spike in processor usage for the past few days. Is there an app or an add-on that will show which task is using the resources? like CPU, GPU, Ram etc. I have Glances installed but may be i didnt spend time with it much but it looks like it is just giving the snapshot of whats currently happening rather than giving us a graph or a more detailed info. Also its difficult to read? May be its just me whos finding it difficult? for all you pros out there how are u monitoring your system? Thanks for listening. 🙂

[lofty canopy]

Glances can store this data in the InfluxDB addon which you can then graph with the grafana addon. Not exactly trivial though.
What makes it hard to read for you?

[icy harbor]

but it still does not tell us what exactly is using the resources does it?

[lofty canopy]

Can you share a picture of your glances?

[icy harbor]

like for example why is my CPU usage sometimes goes past 100 percent?

[lofty canopy]

See pictures here for example: https://grafana.com/grafana/dashboards/21147-glances-2024/

[icy harbor]

thats still better monitoring. but does not tell me task specific issues?

[lofty canopy]

I'm guessing it's frgate/go2rtc. CPU utilization can go over 100% depending how it's computed. I.e 8 cores at 100% = 800%.

[icy harbor]

so what I can tell is that its a wrapper to diaplay info from glance?

[lofty canopy]

That's a pre made dashboard for grafana.

Basically glances ships the data you see into the database and grafana can graph that data.

[icy harbor]

ah ok. Yeah Frigate is my latest add on and it was hogging all the resources. but its better now that i have the cameras and settings tweaked.

[lofty canopy]

Have you set up hardware acceleration for frigate? https://docs.frigate.video/configuration/hardware_acceleration/
Also make sure you calibrate detection properly.

[icy harbor]

yes and OpenVino

[lofty canopy]

By the way if you press / or wherever that key would be on a english keyboard you can see the command args in glances.

Frigate also has its own stats in the GUI.

[icy harbor]

can u explain this part?

[lofty canopy]

Take a look at the bottom right. You see ffmpeg but not the rest of the arguments of that command. That key will show them.

[icy harbor]

Frigate stats

[icy harbor]

Oh this worked!

[lofty canopy]

Hmm that looks okay to me. I'm guessing it's go2rtc related then? Not a frigate expert.

[icy harbor]

I am using go2rtc

So looks like its always this camera that is using the CPU the most.

[lofty canopy]

Can you scroll to the side so the full command is visible?

Would you mind sharing your sanitized config?

[icy harbor]

ffmpeg -hide_banner -v error -fflags nobuffer -flags low_delay -timeout 5000000 -user_agent go2rtc/ffmpeg -rtsp_flags prefer_tcp -i rtsp://MyIP/camera_high?video&source=ffmpeg:front_door_camera_high%23video%3Dh264%23rotate%3D90 -c:v libx264 -g 50 -profile:v high -level:v 4.1 -preset:v superfast -tune:v zerolatency -pix_fmt:v yuv420p -an -vf transpose=1 -user_agent ffmpeg/go2rtc -rtsp_transport tcp -f rtsp rtsp://MyIp/849bcddabb736b06

this is the full log

[icy harbor]

for frigate?

I am also rotating that camera 90 degrees so that also contributes but that much?

[lofty canopy]

Yep. I likely can't help much with it but maybe nick will find its way here and would probaby ask for it anyways.

[icy harbor]

nick?

[lofty canopy]

A well known frigate contributor: https://github.com/blakeblackshear/frigate/graphs/contributors

Hmm. I see no HW acceleration args in that command and your CPU isn't exactly fast. Can you share the frigate config?

[icy harbor]

So i am using "ffmpeg: hwaccel_args: preset-vaapi" as a general frigate setting

camera:
ffmpeg:
inputs:
- path: rtsp://IP/camera_low_rotated
roles:
- detect
- path: rtsp://IP/camera_high_rotated
roles:
- record
detect:
width: 720 # update to match your camera
height: 1280 # update to match your camera
fps: 5
snapshots:
enabled: true
timestamp: true
bounding_box: true
retain:
default: 2
record:
enabled: true
retain:
days: 1
alerts:
retain:
days: 5
detections:
retain:
days: 5
motion:
mask:
- 0,0.667,0.559,0.677,0.528,0.2,0,0.161
- 0,0.187,0.528,0.227,1,0.118,1,0,0,0
zones:
front_door:
coordinates: 0,0.672,0.595,0.682,0.565,0.28,1,0.184,1,1,0,1
loitering_time: 0
inertia: 3

[lofty canopy]

Maybe it has to do with how the stream is created in your case. I run frigate standalone as a docker container. Config files like that need code blocks so the formatting is preserved.

[tough kettle]

To format your text as code, enter three backticks on the first line, press Enter for a new line, paste your code, press Enter again for another new line, and lastly three more backticks.
```yaml
example: here
```
Don't forget you can edit your post rather than repeatedly posting the same thing.

[icy harbor]

'''
mqtt:
host: ip
port: 1883
topic_prefix: frigate
client_id: frigate
user: username
password: password
stats_interval: 300

ffmpeg:
hwaccel_args: preset-vaapi

detectors:
ov:
type: openvino
device: GPU

model:
width: 300
height: 300
input_tensor: nhwc
input_pixel_format: bgr
path: /openvino-model/ssdlite_mobilenet_v2.xml
labelmap_path: /openvino-model/coco_91cl_bkgr.txt

cameras:
front_door_camera:
ffmpeg:
inputs:
- path: rtsp://IP/camera_low_rotated
roles:
- detect
- path: rtsp://IP/camera_high_rotated
roles:
- record
detect:
width: 720 # update to match your camera
height: 1280 # update to match your camera
fps: 5
snapshots:
enabled: true
timestamp: true
bounding_box: true
retain:
default: 2
record:
enabled: true
retain:
days: 1
alerts:
retain:
days: 5
detections:
retain:
days: 5
motion:
mask:
- 0,0.667,0.559,0.677,0.528,0.2,0,0.161
- 0,0.187,0.528,0.227,1,0.118,1,0,0,0
zones:
front_door:
coordinates: 0,0.672,0.595,0.682,0.565,0.28,1,0.184,1,1,0,1
loitering_time: 0
inertia: 3
version: 0.15-1
camera_groups: {}'''

[icy harbor]

this is the full code

[lofty canopy]

Backticks, not apostrophes 🙂
Looks okay to me but I can't give much more specific advice here.