Coral AI Person Detection with Home Assistant & Frigate
ฝัง
- เผยแพร่เมื่อ 5 ส.ค. 2024
- This video 📹 is a must-watch for anyone who wants to learn the easiest way to get Local Object Detection in Home Assistant with Frigate.
We’ll guide you through the process step-by-step, so you can get started right away, use it in your dashboard, and even get mobile notifications 🚀🏡.
FixtSE Web: fixtse.com/blog/coral-ia-frigate
Documentation:
Supported Objects: docs.frigate.video/configurat...
Hardware Acceleration: docs.frigate.video/configurat...
Coral TPU USB Accelerator
Amazon Affiliate Links: amzn.to/3RvvJtV
Aliexpress: s.click.aliexpress.com/e/_DEX...
00:00 Prerequisites
01:00 Frigate Full Access Add-On
01:36 Frigate Integration
02:00 Frigate Card
02:30 Mosquitto Broker Add-On
02:56 Create Configuration File
03:21 Configuration
03:49 Add a Camera to Frigate
06:08 Check if Frigate is using the Coral TPU
06:17 Advanced Camera Example
06:39 How To Create a Mask
07:37 How To Create a Zone
09:05 Verify Zone and Mask Creation
10:27 Use It In Your Dashboard
12:01 Mobile Notifications Blueprint
Raspberry Pi 4:
Amazon Affiliate Links:
Raspberry Pi 4 Kit (4gb): amzn.to/44Uwpwu
Raspberry Pi 4 Kit (8gb): amzn.to/3LluolW
Kingston A400 SSD: amzn.to/3t3qIig
UGREEN USB 3.0 CASE: amzn.to/3EH3cdQ
UGREEN USB 3.0 CASE WITH External Power Supply: amzn.to/3ZiVJuK
UTP Cable: amzn.to/3ED9lr8
Aliexpress:
Raspberry Pi 4 Kit: s.click.aliexpress.com/e/_DFO...
MicroSD Card Reader: s.click.aliexpress.com/e/_DDC...
Kingston A400 SSD: s.click.aliexpress.com/e/_DFK...
USB 3.0 CASE: s.click.aliexpress.com/e/_DlY...
UTP Cable: s.click.aliexpress.com/e/_ATa7be
If you like my work, please consider supporting me on Ko-fi! ☕🎉: ko-fi.com/fixtse
You can find me on:
Web: fixtse.com/
Instagram: / fixtse
Hope this was useful and if you have any questions, write me a comment below
Thank you for watching (~ ̄▽ ̄)~ - วิทยาศาสตร์และเทคโนโลยี
Excelente, imposible perderse muchas felicidades por tu canal ❤
Thank you for the great guide, your template for configuration file helped me a lot to get started.
Bravo from Athens Greece
great video mate!
Wow, this helped me lots, thankyou.
Me encanto el video
wowser, thank you!
Super! Thank You! 👍
🙌🙌 Glad that it helped!
Great video
Thanks
Great tutorial, but i get an error when trying to start the frigate addon. Says port 8555 is already in use. Guess i have some other integration that is using that port, but i'm not skilled enough to figure it out. Guess it could be the WebRTC i'm currently using to watch my cameras.
But my HAOS crashed something fierce when i tried getting it to work, so now i'm a little timid to try again.
super tutorial, thank you :)
Valeu!
What is the best iso or andriod app so i can see my cameras outside my network?
Can you control a PTZ camera from frigate card ? If so how ?
Hi Fixt, which smart home cameras are you using? do I have to use any specific camera to configure with frigate? does Wyze camera work with frigate?
Hi, I'm using Yi Dome Cameras (with a custom firmware to enable RTSP support for local use). Not an specific camera, but It should support the RTSP protocol so you can add the feed to Frigate. Wyze firmware used to have RTSP support, but I read somewhere, that they are removing the RTSP support on their newer versions of their original firmware. If that is your case, I'm sure there must be ways (google it, use the exact model of your cameras in your search) to flash an older version of the firmware that has RTSP support enabled.
Is someone in 2024 have a luck to install coral edgeptu pci-express in Ubuntu 22.04? My setup is HP Elitedesk 800 G3 and dual edgeptu pci express card.
do you know if coral USB works with home assistant Green device?
Nice video! What kind of storage are you using for this? Does this ball down the PI CPU?
Bog down the CPU, sorry
@@MikeFrantz-zl6yi Hi, I'm using a 500gb Kingston A400 SSD, it has low power consumption needs, so I don't need an external power supply. Yes, since all the motion detection, encoding and decoding process it's CPU based (only the classification is off-load to the TPU), every 1080p camera consumes around 20% off the pi's CPU. I tested it with 3 streams, without any issues, with the default power supply.
Hello, I have a question for you: Is it possible to use this system to understand who is coming to my home or to my workplace, that is, is it possible to perform facial recognition like on an iPhone? To give an example, is it possible to have it recognize me when I arrive in front of my house and open the door automatically?
No, this is person detection, not facial recognition. But it can be achieved (just different software)
I've followed this guide using a Pi4 and a Coral. Frigate has detected my Coral but when I look at the FFmpeg CPU usage in the "system" tab in Frigate, it seems to sit at about 40%. This seems high?
It's normal, lots of transcoding is involved in getting it working (it uses the CPU, not the coral NPU). Just think of this, every frame from every camera needs to be processed by the system in order to be usable for the recognition model used by the NPU.
Ima try this. I found a good mini server for 15 bucks and it has a mini pcie and google makes one for that so i might try this.
Thank you for your informative work, i am a beginer in home assistant, i dont have an existing NVR camera system..but i want to implement one. I am stuck on how am going to connect the physical network system between NVR network and HOME ASSISTANT server
the system should support the RSTP protocol (is kind of the standard now), you can add any RSTP stream to Frigate and use it as a camera.
Thx for a great video and guide 🙂
I am having an issue when accessing the 'System' section in the Frigate integration.
The page is just blank, but I can see in the logs, that the TPU is found.
Still, there is nothing under the 'system' section.
Do you know what could be the issue?
Mmmm if there is nothing in the logs, try to uninstall and reinstall the add-on, if that doesn't help, try a different browser (it might be a cache issue)
Genius! Sometimes it's just to simple. Changing the browser did the trick. Also did a cache wipe, which also fixed the issue.
Thank you for your assistance and for the great video.
@@fixtse.
Frigate saving file is a huge.. Do you add aditional external storage to your pi for save the frigate recorded file?
Hi, yes, I'm using a dedicated 500 gb low power consumption SSD (with an USB 3.0 enclosure) to store the files
@@fixtse. Thank you so much.. I always waiting for your HA video.. Really hope you can continue the good work and keep sharing 😁
@@fixtse. Hi, can you share how to store the frigate file to external disk if we use rasp/NUC for HA?
Thank you for the video. Can the blueprint be used to notify my Nvidia Shield , which I use to watch all my content?
Yes, it uses any notify service available to home assistant, create one for your nvidia shield and test it first, once it is working, you can use it with this blueprint
@@fixtse.Thank you. Now I must try and figure out how to do that. Very new with the automation part still.
I have the edgetpu m.2 version instead of usb. How do i define this within frigate.yml? device: ?"
Thank you!
You are going to need to go and read the documentation for that
Thak you for the video. Sometimes i have a small issue with my automations. Today when i fixed my internet problem my automation either sends a notification with a 20 min or 10 min delay or it just doesn't sens anything. When it does for some reason i noticed it accepts a 58% confidence obcject. I once had this problem and i fixed it by bumping up my alert priority in my phone Xiaomi redmi note 8t to high but now i have no idea how to fix this any tips? Should i just create it again from scratch and go from there or is there some actual reason for this?
This is interesting, I dont have a clue what can be causing this (there are too many moving parts to tell). But for the part I know, there should be no delay on home assistant side to send the notification to your phone, it should work instantly. Have you check how well on resources is your server?
@@fixtse. Thanks for responding after tinkering with my zone and some settings the automation it works properly at least today. I think the problem was with my zone since I made it not that large and sometimes when I even walked through it it wouldn't light up in the debug frigate menu. About my server it runs on my pi4B with 4gb of ram so I don't think that would be an issue.
Does Frigate support PTZ camera’s?
Not really, but if you use the WebRTC card on your dashboard, you can point it to a frigate camera, and use the controls pointing to the PTZ service that controls the camera. I have a similar setup in my dashboard and it's working perfectly. (if you don't like the controls of the card, you can add some buttons to trigger PTZ presets as an option)
I still hope that someone adds models to detect also rats, mice and snakes. am I the only one?
jeje, You might want to look into how to create a personalized detection model. Who knows, you might end up being the one who solves that problem for everyone!
Does it come with the 🐈? 👀
No, he owns everything