Frigate - Semantic Search + GenAI | Home Assistant | Page 1

open wyvern Dec 11, 2024, 4:47 PM

#

Just want to confirm, I'm changing my docker file to use image: ghcr.io/blakeblackshear/frigate:0.15.0-beta3-tensorrt so I can use my Nvidia 2060 for semantic search properly.. it won't have any other unintended effects?

open wyvern Dec 11, 2024, 5:35 PM

#

Frigate - Semantic Search + GenAI

#

And, is it possible to rate-limit GenAi queries?

#

I have setup my Gemini and a budget alert. My local GPU is 2060 6GB, not sure if I can fit ollama models in there and leave room for the rest of the GPU work it needs to do?

sudden inlet Dec 11, 2024, 7:55 PM

#

open wyvern Just want to confirm, I'm changing my docker file to use `image: ghcr.io/blakebl...

Are you already using your nvidia for object detection?

open wyvern Dec 11, 2024, 7:56 PM

#

sudden inlet Are you already using your nvidia for object detection?

Nope, coral

sudden inlet Dec 11, 2024, 7:56 PM

#

Should be fine then

#

There is no rate limiter built into frigate, so you may want to only use GenAI on certain cameras or object types

#

Also, if you haven't seen this tip on Semantic Search and GenAI, check it out - some users have found that they are not utilizing GenAI after discovering the power of Semantic Search: https://github.com/blakeblackshear/frigate/discussions/14654

GitHub

Frigate Tip: Semantic Search and Generative AI (0.15 beta) · blakeb...

The Frigate Tips series is a collection of posts where the Frigate developers give tips on how to best configure, use, and maintain your Frigate installation. Frigate 0.15 beta includes a powerful ...

#Frigate - Semantic Search + GenAI