GPU for Frigate

[nimble quiver]

Hi, I have a home server with an old Ryzen 5 5700, 32 GB RAM, running Proxmox. I’m using a VM for Home Assistant, and an LXC container for Frigate, along with some Docker containers.

I have 4 cameras and want to improve movement detection using Frigate’s AI. What is the best low‑power GPU for this use case?

I can get a GTX 1650 for €50 or an Intel Arc A310 for €120. Are there any other options? I don’t have any more NVMe slots available.

[peak bloom]

Personally, I would look into a mini PC for frigate, due to the low power of running them 24/7. There are very beastly frigate mini PCs that can be obtained for quite cheap

[deep night]

This Is what I do, with a coral TPU, unfortunately those became super hard to find 🙁 So sometimes a GPU comes out cheaper

[deep night]

If you can swing a RTX 5050, this would insure that the GPU can transcode any existing codec as of today.

Meaning that if you are to place this GPU in a different role, such as a Jellyfin/Plex/Nextcloud server in the future, it could do transcoding there.

Now, for the 1650, I believe that RT cores were introduced with the 2000* series.
I would grab a 2050/2060 over a 1650 for that reason, again for a 'tad' of futureproofing

[nimble quiver]

Currently, I’m using an RTX 2070 (my old PC GPU), but it’s overkill and consumes too much power for what it’s doing.

I found some USB Coral devices for around €100, so that remains affordable.

As for the GTX 1650, it has already been sold, so I’m dropping that option.

5050 maybe 🤔

[nimble quiver]

I’m using this server because it allows me to run virtualization alongside it and host multiple services at home, so a mini PC doesn’t really fit my needs.

Especially since I already had all these components — it’s basically recycled hardware.

[versed dirge]

have you tried locking the GPU and memory clocks lower to reduce power usage?

[vale herald]

Have you tried if OpenVino suffices? Also see: https://docs.frigate.video/frigate/hardware/#google-coral-tpu

[deep night]

Is the consumption even that bad with a 2070?

My 3090 idles at 20W with 22gb of it loaded in permanance. Surely a 2070 can't be above 15 watts

[nimble quiver]

idk i need to check this