frigate bird detection | Home Assistant | Page 1

cinder sigil May 30, 2023, 8:56 PM

#

mqtt:
  host: ipaddress
  user: user
  password: pass
  enabled: true

detectors:
  ov:
    type: openvino
    device: AUTO
    model:
      path: /openvino-model/ssdlite_mobilenet_v2.xml

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt
    
cameras:
  feeders:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
        - path: rtsp://user:pass@IPADDRESS:PORT/h264Preview_01_main
          roles:
            - detect
    detect:
      width: 3840
      height: 2160
    mqtt:
      enabled: true
      bounding_box: false
      quality: 100
    objects:
     track:
       - bird
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: false
      retain:
        default: 1

#

frigate bird detection

#

doesn't appear like it's dropping any frames in system info. detector using about 10% CPU

worn kelp May 30, 2023, 9:04 PM

#

your problem is most likely due to motion detection, not the resolution of the stream

#

need to make motion detection more sensitive

#

the debug view will be your friend

cinder sigil May 30, 2023, 9:07 PM

#

yeah I've been looking at the debug viewer. I do agree I think it's motion.. the issue is the feeder itself moves around so it boxes in the entire area that includes the feeder and birds

#

the image quality is pretty good, but yeah when there's a lot of motion it seems to not pickup the birds

image sample with a bird in it: https://i.imgur.com/yLfUJ3O.jpg

#

but as you can see here the entire area sways in the breeze a little bit and has a motion block around it: https://i.imgur.com/XVYagVK.png

worn kelp May 30, 2023, 9:13 PM

#

that doesn't matter

#

you should not be worried about excluding motion until what you want is being detected

cinder sigil May 30, 2023, 9:13 PM

#

okay

#

I'm still not sure what to tweak if I'm being honest

worn kelp May 30, 2023, 9:14 PM

#

Do you see motion boxes when birds are moving / come to the feeder?

cinder sigil May 30, 2023, 9:14 PM

#

I do not, just the big blob for the feeder itself in which the bird is inside of

#

https://i.imgur.com/5gCGuaa.png

#

the bird is moving around inside of the feeder area - but motion it constantly drawing a boundary around the entire feeder itself. Does this matter?

worn kelp May 30, 2023, 9:39 PM

#

No, it only matters if a bird is arrives and no motion box was drawn which means frigate did not see motion

#

I'm also not 100% sure how well the default openvino model works for bird detection, so that could be another factor

cinder sigil May 30, 2023, 9:40 PM

#

hmm, well it's detecting motion the birds have a box around them but I don't see the blue/yellow box that correlating them to an object

#

under the detectors? I had it turned off just trying to play with it, so default is CPU I believe? it didn't fare any better. I don't have access to a coral device

worn kelp May 30, 2023, 9:41 PM

#

Your config you put above does not show it turned off

cinder sigil May 30, 2023, 9:42 PM

#

yeah, I only put that in a few moments ago before sharing to see if it was better

worn kelp May 30, 2023, 9:42 PM

#

So you have bounding boxes enabled and it does now show any correct?

cinder sigil May 30, 2023, 9:42 PM

#

yes correct

#

it does grab them sometimes but it's not very good or frequent

cinder sigil May 30, 2023, 10:23 PM

#

I put the camera pretty much smack dead-on facing the feeder. I don't know how it's not picking these up haha https://i.imgur.com/myxeCuS.png that's some pretty solid bird there

worn kelp May 30, 2023, 11:20 PM

#

You have to consider how the images were trained. It doesn't look like that in the COCO dataset

#frigate bird detection