AI Detection & Automation with Reolink

[tough lantern]

Hi,

I have Reolink cameras and was wondering if it's possible to integrate an AI system with Home Assistant (HA) that can detect a specific person or license plate and trigger an automation based on that detection.

From what I understand, the Reolink integration only supports general person and animal detection but does not identify specific individuals. Is that correct?

I also have a Reolink NVR and wasn't very familiar with Blue Iris before setting up my system. My HA setup is currently running on a laptop with a GTX 1060 or 1070 and an Intel i7 processor (I don’t recall the exact generation). From what I’ve gathered, I might need to install Proxmox on the laptop and then run both HA and Blue Iris within it. Is that the best approach? Or would I be able to run Blue Iris directly inside of HA?

My goal is to auto unlock/lock the doors and open/close garage doors. if there is a way to this much simpler way I'd appreciate the input.
Thanks for your help!

[pastel saffron]

If not supported by the reolink app you may need frigate nvr with coral usb device.

[stuck ingot]

yeah frigate will help with object detection but specific car/person will probably require a bit more. i beleive frigate+ does allow for some more specific stuff. i think ANPR is part of it but i dont know about facial recognition. will want a TPU for this but thats easy enough by usb

theres probably other ways of achiving the goal though.

something like using an espressense setup to track ble becons from a phone or smartwatch or something to track a persons location

i have no idea about blue iris, we do open source around here 🙂

i do recomend proxmox installed on the host so that way you can run haos in a VM and then run whatever else you want in other VM's/LXC's

[tough lantern]

thank you Michael. For the espressense setup what i'm wondering about is wouldn't it trigger the automation if i'm inside the house just as if I was outside the house? Or is there a way for it that it can tell the direction

[fallen lily]

@tough lantern I think this might be helpful for you. https://youtu.be/SOjaOq25hgg?si=KLx78EIJiThq85GX

The automation is when there is motion, HA sends the snapshot to AI, and AI creates a short description of the image. HA then sends a notification to their phones.

[tough lantern]

thank you very much! I'm going to check this out and see if I can get it to work for the front door

i'm also trying icloud device but it seems like it only updates every 15 minutes only

[fallen lily]

@tough lantern Let me know how it goes. I've got a Reolink doorbell and I'm working on using a local LLM to do this. I'm trying to crawl with using an LLM before I run with it.

[stuck ingot]

it uses the distance from the device with multiple sensors and then can track an "exact" location within a margin of error. i have messed with it a bit but not a massive ammount so i cant be entirily sure how precise it it. but i have heard from people that it can be pretty good

[tough lantern]

ordered 3 of them as well this morning. Let's see how all this goes lol

[tough lantern]

I got the 3 esp32 sensors and:
1- I have flashed the device.
2- on chrome it asks me to give it my wifi username and pass for it to connect to and no matter how many times i've tried it keeps timing out.
3- i went into the config page and it doesn't show a lot of the settings that everything smart home has in his (video is from 3 years ago). https://www.youtube.com/watch?v=p7C2QvmsM8M
4- I have put my phone and smart watch close to it and go their ID in it's console log.

i have Mosquitto broker installed, setup a mqtt user and password, after that i'm confused as my config page is different than from the videos and I can't get it to connect to my wifi.

I'm confused where to go from here. Is there any videos that walks through it well or any docs?