Security camera object detection with Home Assistant, Frigate, and Google Coral
ฝัง
- เผยแพร่เมื่อ 27 ก.ย. 2024
- (ReUploaded to fix audio) Welcome to my first foray into computer vision! This was a hard one so I have a whole list of resources here for you to use:
Proxmox: www.proxmox.co...
Home Assistant: www.home-assis...
Frigate: docs.frigate.v...
Google Coral: coral.ai/
Project-Specific Resources:
- My project on Github: github.com/tde...
- Explanation of how Tensor Cores work: • Analysis of a Tensor Core
Thanks for watching, and see you next time!
I'd love to see your support:
Patreon: / thomascomputes (please only sign up after you are sure you can take care of yourself and your family, I really do mean that)
Discord: / discord
Instagram: / thomas_computes
Twitter: / thomas_computes (I'm not thomascomputes, the underscore is very important in this case HAHA)
Discord: / discord
Even TikTok! / thomascomputer
From the first upload, there was a question I wanted to help answer:
"Do only non-K Intel CPUs support VT-d?" -- No, that was really only the case in some earlier generations of Core CPUs. Here's a list of CPUs that support VT-d for PCIe passthrough: ark.intel.com/content/www/us/en/ark/search/featurefilter.html?productType=873&2_VTX=true
Be sure to keep up to date with the GitHub repo! I'll be adding more documentation here as I start to receive more feedback and questions: github.com/tdesrosi/object-detection-with-frigate
you went from concept to concept, more and more complicated and explained each one extremely well. you're a natural teacher 👏
Love the editing. If you keep making videos, your personality just has to go viral. Great video, thank you for the detailed info.
You sir are a gentleman and a scholar. Frigate is a pain to configure. Thanks for providing your yml file.
Happy you are still making videos. I had considered a similar set up for my apartment. Sounds like skipping the ML portion might be the way to go!
I’m sure it would be fun to learn OpenCV and Tensorflow and try to build something from scratch one day, but boy what a time commitment that would be!
i'm glad I discovered this channel. Keep up the great work
I became a subscriber back in October when I was researching building my own router and found your video.
Today I went down a rabbit hole and was looking at devices that could be installed into an m.2 slot. It mentioned a coral m.2 edge tpu and I'd never heard of it before.
Looked up the coral one of the 3 videos on TH-cam about Google coral is your video! If I wasn't already a subscriber you would have hooked me again.
Good to see you're still making videos!
You need a proper converter for PCI TPU cards. You can run lspci and see whether you can see it in the list. If not that means something wrong with PCI converters
You should look into.the hailo 8 edge compute. Walks all.over the coral
Might be a stupid question but can you run this security application and tpu with a usb c camera like a gopro?
Where did you get your Coral USB accelerator? They seem to be backordered forever most places, except if one wants to pay a small fortune.
The USB one from Amazon actually, they must have restocked at just the right moment I guess! The M.2 one was tricky, I had to order from a small distributor in the UK and it took a long time to arrive. I feel your pain, and likewise won’t be doing any Raspberry Pi videos anytime soon.
coral TPU support for Immich soon :D
I’m so glad I found ur channel! Awesome stuff bro
get to the point faster
Great video! I
I understand the suffering you had to endure trying to get hardware device passthrough to work via proxmox too!
I do gotta add though, your Reolink 520 at the start looks like it was running at a ridiculously low bitrate and framerate.
Perhaps that was just a low bandwidth substream though?
Appreciate your expertise. What cameras do you recommend?
Salty Cracker FTW
Good explanation man!
I would focus on getting that m.2 TPU working, that unit looked the the dual edge version which means its has 2 TPU processors on it vs the USB single processor unit. Probably wont make a difference with a single camera but it is a more powerful TPU if running properly. Your conversion will probably work if you get a PCIe -> e key adaptor (check some desktop PCIe wireless adaptors) instead of PCIe -> mini PCI -> E key, however this might still only get you a single TPU working on the dual edge m.2 card.
Yeah it's a real bummer that I couldn't figure it out for this video... I think it just gets too complicated with frigate running as an add-on in HASS which is running in a VM, and I'm going to revisit this at some point to do a standalone Frigate containerized deployment, which can then just connect to home assistant with the Frigate connector add-on... Love the feedback!
@@ThomasComputes I don't know if this was your problem or not, but I thought I might mention it in case it might be helpful. I have no experience with this particular device, but I have in the past run into issues with mPCIe cards (or rather what I initially thought were mPCIe cards) in mPCIe to PCIe adapters. One problem is that mPCIe, and I believe the same is true for M.2, is sometimes just used as a "form factor". By that, I mean the devices have the same connector and form factor, but they are not actual PCIe devices. Instead they are actually either usb or SATA devices. If that's the case, these mPCIe to PCIe adapters won't work because the PCIe slot your plugging them into on your motherboard only talks PCIe and won't see USB or SATA devices. Seeing as how this device comes in a USB version, there's a chance that might be the case here and the mPCIe and M.2 form factor versions are only using a different form factor and are actually USB devices. The thing to do might be to try an mPCIe to usb adapter. If you do that and it works, it's actually a USB device, just using the m.2 form factor.
@@stefanl5183 The M.2 Coral module is not USB. Do a search for "MBS.PCI20102.2"