Coral AI Person Detection with Home Assistant & Frigate

แชร์
ฝัง
  • เผยแพร่เมื่อ 5 ส.ค. 2024
  • This video 📹 is a must-watch for anyone who wants to learn the easiest way to get Local Object Detection in Home Assistant with Frigate.
    We’ll guide you through the process step-by-step, so you can get started right away, use it in your dashboard, and even get mobile notifications 🚀🏡.
    FixtSE Web: fixtse.com/blog/coral-ia-frigate
    Documentation:
    Supported Objects: docs.frigate.video/configurat...
    Hardware Acceleration: docs.frigate.video/configurat...
    Coral TPU USB Accelerator
    Amazon Affiliate Links: amzn.to/3RvvJtV
    Aliexpress: s.click.aliexpress.com/e/_DEX...
    00:00 Prerequisites
    01:00 Frigate Full Access Add-On
    01:36 Frigate Integration
    02:00 Frigate Card
    02:30 Mosquitto Broker Add-On
    02:56 Create Configuration File
    03:21 Configuration
    03:49 Add a Camera to Frigate
    06:08 Check if Frigate is using the Coral TPU
    06:17 Advanced Camera Example
    06:39 How To Create a Mask
    07:37 How To Create a Zone
    09:05 Verify Zone and Mask Creation
    10:27 Use It In Your Dashboard
    12:01 Mobile Notifications Blueprint
    Raspberry Pi 4:
    Amazon Affiliate Links:
    Raspberry Pi 4 Kit (4gb): amzn.to/44Uwpwu
    Raspberry Pi 4 Kit (8gb): amzn.to/3LluolW
    Kingston A400 SSD: amzn.to/3t3qIig
    UGREEN USB 3.0 CASE: amzn.to/3EH3cdQ
    UGREEN USB 3.0 CASE WITH External Power Supply: amzn.to/3ZiVJuK
    UTP Cable: amzn.to/3ED9lr8
    Aliexpress:
    Raspberry Pi 4 Kit: s.click.aliexpress.com/e/_DFO...
    MicroSD Card Reader: s.click.aliexpress.com/e/_DDC...
    Kingston A400 SSD: s.click.aliexpress.com/e/_DFK...
    USB 3.0 CASE: s.click.aliexpress.com/e/_DlY...
    UTP Cable: s.click.aliexpress.com/e/_ATa7be
    If you like my work, please consider supporting me on Ko-fi! ☕🎉: ko-fi.com/fixtse
    You can find me on:
    Web: fixtse.com/
    Instagram: / fixtse
    Hope this was useful and if you have any questions, write me a comment below
    Thank you for watching (~ ̄▽ ̄)~
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 51

  • @ricardopinaarevalo4232
    @ricardopinaarevalo4232 8 หลายเดือนก่อน +1

    Excelente, imposible perderse muchas felicidades por tu canal ❤

  • @Rymden2
    @Rymden2 6 หลายเดือนก่อน

    Thank you for the great guide, your template for configuration file helped me a lot to get started.

  • @gbadishomeassistant748
    @gbadishomeassistant748 8 หลายเดือนก่อน +1

    Bravo from Athens Greece

  • @simonsayshomeassistant
    @simonsayshomeassistant 7 หลายเดือนก่อน +1

    great video mate!

  • @DoctorJ3kyll
    @DoctorJ3kyll 4 หลายเดือนก่อน

    Wow, this helped me lots, thankyou.

  • @sinthiadiazplasencia4099
    @sinthiadiazplasencia4099 8 หลายเดือนก่อน +2

    Me encanto el video

  • @koolkiwikat
    @koolkiwikat 6 หลายเดือนก่อน

    wowser, thank you!

  • @arnoldbencz6886
    @arnoldbencz6886 6 หลายเดือนก่อน

    Super! Thank You! 👍

    • @fixtse.
      @fixtse.  6 หลายเดือนก่อน

      🙌🙌 Glad that it helped!

  • @alencarvilela
    @alencarvilela 7 หลายเดือนก่อน

    Great video

  • @MetinAnac-xm1ku
    @MetinAnac-xm1ku 3 หลายเดือนก่อน

    Thanks

  • @petergdk
    @petergdk 4 หลายเดือนก่อน +2

    Great tutorial, but i get an error when trying to start the frigate addon. Says port 8555 is already in use. Guess i have some other integration that is using that port, but i'm not skilled enough to figure it out. Guess it could be the WebRTC i'm currently using to watch my cameras.
    But my HAOS crashed something fierce when i tried getting it to work, so now i'm a little timid to try again.

  • @piotr.wozniak
    @piotr.wozniak 2 หลายเดือนก่อน

    super tutorial, thank you :)

  • @alencarvilela
    @alencarvilela 6 หลายเดือนก่อน

    Valeu!

  • @lewistaylor6695
    @lewistaylor6695 4 หลายเดือนก่อน

    What is the best iso or andriod app so i can see my cameras outside my network?

  • @shannonbreaux8442
    @shannonbreaux8442 6 หลายเดือนก่อน

    Can you control a PTZ camera from frigate card ? If so how ?

  • @achayanteideas4610
    @achayanteideas4610 7 หลายเดือนก่อน

    Hi Fixt, which smart home cameras are you using? do I have to use any specific camera to configure with frigate? does Wyze camera work with frigate?

    • @fixtse.
      @fixtse.  7 หลายเดือนก่อน +1

      Hi, I'm using Yi Dome Cameras (with a custom firmware to enable RTSP support for local use). Not an specific camera, but It should support the RTSP protocol so you can add the feed to Frigate. Wyze firmware used to have RTSP support, but I read somewhere, that they are removing the RTSP support on their newer versions of their original firmware. If that is your case, I'm sure there must be ways (google it, use the exact model of your cameras in your search) to flash an older version of the firmware that has RTSP support enabled.

  • @nurmukhamedartykaly4005
    @nurmukhamedartykaly4005 6 หลายเดือนก่อน +1

    Is someone in 2024 have a luck to install coral edgeptu pci-express in Ubuntu 22.04? My setup is HP Elitedesk 800 G3 and dual edgeptu pci express card.

  • @Biagioinca
    @Biagioinca หลายเดือนก่อน

    do you know if coral USB works with home assistant Green device?

  • @MikeFrantz-zl6yi
    @MikeFrantz-zl6yi 8 หลายเดือนก่อน +1

    Nice video! What kind of storage are you using for this? Does this ball down the PI CPU?

    • @MikeFrantz-zl6yi
      @MikeFrantz-zl6yi 8 หลายเดือนก่อน +1

      Bog down the CPU, sorry

    • @fixtse.
      @fixtse.  7 หลายเดือนก่อน +3

      @@MikeFrantz-zl6yi Hi, I'm using a 500gb Kingston A400 SSD, it has low power consumption needs, so I don't need an external power supply. Yes, since all the motion detection, encoding and decoding process it's CPU based (only the classification is off-load to the TPU), every 1080p camera consumes around 20% off the pi's CPU. I tested it with 3 streams, without any issues, with the default power supply.

  • @kaandurgut
    @kaandurgut 4 หลายเดือนก่อน +1

    Hello, I have a question for you: Is it possible to use this system to understand who is coming to my home or to my workplace, that is, is it possible to perform facial recognition like on an iPhone? To give an example, is it possible to have it recognize me when I arrive in front of my house and open the door automatically?

    • @fixtse.
      @fixtse.  4 หลายเดือนก่อน

      No, this is person detection, not facial recognition. But it can be achieved (just different software)

  • @barrycraig
    @barrycraig 27 วันที่ผ่านมา

    I've followed this guide using a Pi4 and a Coral. Frigate has detected my Coral but when I look at the FFmpeg CPU usage in the "system" tab in Frigate, it seems to sit at about 40%. This seems high?

    • @fixtse.
      @fixtse.  12 วันที่ผ่านมา +1

      It's normal, lots of transcoding is involved in getting it working (it uses the CPU, not the coral NPU). Just think of this, every frame from every camera needs to be processed by the system in order to be usable for the recognition model used by the NPU.

  • @turtepas
    @turtepas หลายเดือนก่อน

    Ima try this. I found a good mini server for 15 bucks and it has a mini pcie and google makes one for that so i might try this.

  • @ramadanmusa3116
    @ramadanmusa3116 7 หลายเดือนก่อน

    Thank you for your informative work, i am a beginer in home assistant, i dont have an existing NVR camera system..but i want to implement one. I am stuck on how am going to connect the physical network system between NVR network and HOME ASSISTANT server

    • @fixtse.
      @fixtse.  7 หลายเดือนก่อน

      the system should support the RSTP protocol (is kind of the standard now), you can add any RSTP stream to Frigate and use it as a camera.

  • @storebatfar
    @storebatfar 7 หลายเดือนก่อน

    Thx for a great video and guide 🙂
    I am having an issue when accessing the 'System' section in the Frigate integration.
    The page is just blank, but I can see in the logs, that the TPU is found.
    Still, there is nothing under the 'system' section.
    Do you know what could be the issue?

    • @fixtse.
      @fixtse.  7 หลายเดือนก่อน +1

      Mmmm if there is nothing in the logs, try to uninstall and reinstall the add-on, if that doesn't help, try a different browser (it might be a cache issue)

    • @storebatfar
      @storebatfar 7 หลายเดือนก่อน

      Genius! Sometimes it's just to simple. Changing the browser did the trick. Also did a cache wipe, which also fixed the issue.
      Thank you for your assistance and for the great video.
      @@fixtse.

  • @muktheo
    @muktheo 7 หลายเดือนก่อน +1

    Frigate saving file is a huge.. Do you add aditional external storage to your pi for save the frigate recorded file?

    • @fixtse.
      @fixtse.  7 หลายเดือนก่อน

      Hi, yes, I'm using a dedicated 500 gb low power consumption SSD (with an USB 3.0 enclosure) to store the files

    • @muktheo
      @muktheo 7 หลายเดือนก่อน

      @@fixtse. Thank you so much.. I always waiting for your HA video.. Really hope you can continue the good work and keep sharing 😁

    • @muktheo
      @muktheo 7 หลายเดือนก่อน

      @@fixtse. Hi, can you share how to store the frigate file to external disk if we use rasp/NUC for HA?

  • @Hhunted
    @Hhunted 6 หลายเดือนก่อน

    Thank you for the video. Can the blueprint be used to notify my Nvidia Shield , which I use to watch all my content?

    • @fixtse.
      @fixtse.  6 หลายเดือนก่อน

      Yes, it uses any notify service available to home assistant, create one for your nvidia shield and test it first, once it is working, you can use it with this blueprint

    • @Hhunted
      @Hhunted 6 หลายเดือนก่อน

      @@fixtse.Thank you. Now I must try and figure out how to do that. Very new with the automation part still.

  • @renedevrind1733
    @renedevrind1733 6 หลายเดือนก่อน

    I have the edgetpu m.2 version instead of usb. How do i define this within frigate.yml? device: ?"
    Thank you!

    • @fixtse.
      @fixtse.  6 หลายเดือนก่อน

      You are going to need to go and read the documentation for that

  • @havenkoff189
    @havenkoff189 6 หลายเดือนก่อน

    Thak you for the video. Sometimes i have a small issue with my automations. Today when i fixed my internet problem my automation either sends a notification with a 20 min or 10 min delay or it just doesn't sens anything. When it does for some reason i noticed it accepts a 58% confidence obcject. I once had this problem and i fixed it by bumping up my alert priority in my phone Xiaomi redmi note 8t to high but now i have no idea how to fix this any tips? Should i just create it again from scratch and go from there or is there some actual reason for this?

    • @fixtse.
      @fixtse.  6 หลายเดือนก่อน

      This is interesting, I dont have a clue what can be causing this (there are too many moving parts to tell). But for the part I know, there should be no delay on home assistant side to send the notification to your phone, it should work instantly. Have you check how well on resources is your server?

    • @havenkoff189
      @havenkoff189 6 หลายเดือนก่อน

      @@fixtse. Thanks for responding after tinkering with my zone and some settings the automation it works properly at least today. I think the problem was with my zone since I made it not that large and sometimes when I even walked through it it wouldn't light up in the debug frigate menu. About my server it runs on my pi4B with 4gb of ram so I don't think that would be an issue.

  • @efmarosario4953
    @efmarosario4953 5 หลายเดือนก่อน

    Does Frigate support PTZ camera’s?

    • @fixtse.
      @fixtse.  5 หลายเดือนก่อน

      Not really, but if you use the WebRTC card on your dashboard, you can point it to a frigate camera, and use the controls pointing to the PTZ service that controls the camera. I have a similar setup in my dashboard and it's working perfectly. (if you don't like the controls of the card, you can add some buttons to trigger PTZ presets as an option)

  • @czi2011
    @czi2011 16 วันที่ผ่านมา

    I still hope that someone adds models to detect also rats, mice and snakes. am I the only one?

    • @fixtse.
      @fixtse.  12 วันที่ผ่านมา

      jeje, You might want to look into how to create a personalized detection model. Who knows, you might end up being the one who solves that problem for everyone!

  • @franciscoadrianzen2908
    @franciscoadrianzen2908 7 หลายเดือนก่อน

    Does it come with the 🐈? 👀

    • @fixtse.
      @fixtse.  7 หลายเดือนก่อน

      No, he owns everything