"You know what? Fuck you!" 2 seconds later... "I'm so happy clap along of you feel like a room without a roof because I'm happy clap along if you feel like happines is the truth"
I hope his kids trust him with "no logs". Honestly I wouldn't, even if he's a really good person. Because there's simply no way to know. It's similar to knowing your partner's passwords but promising to not to not to go through his stuff. Humans are not meant to be put under camera 24/7.
nah, it's saving money on heating/cooling because you can heat/cool only the zones that you're in, and now with facial recognition you can do it based on individual preferences. the software is all free, and i have no idea what the tpu card goes for.
"House, turn up the thermostat in this room, it's literally freezing in here!" "I'm sorry Linus, I'm afraid I can't do that." Just don't want these things to go all HAL9000 on you.
the great thing about this is that it needs electricity to power itself so you can just shut it off, but if it figures out how to power itself on from sleep mode by running on backup power, and then hosting itself in multiple machines that can detect if its nodes are turned on or off and avidly pursue turning them on, then we have a problem. It even sucks if this kind of thing learns to produce power on its own or use its own methods to optimize its own design by either reducing sensitivity to reduce power consumption or to remove safety features to speed up processing.
@@MrGamelover23 The tensor cores on the RTX card is not used for video decoding or graphics processing but rather mixed-precision computing. Regarding graphics processing they are used for AI-based super resolution with Nvidia's DLSS implementation, but you can use them for lots of deep learning / AI stuff...
@@ubermidget2 Theoretically speaking the Tensor Cores of an Nvidia RTX card would do just fine. The question is how much Frigate supports out of the gate and how much needs to be manually set up. I know they have TensorRT support for CUDA-enabled graphics cards, but I don't know if it has been updated for the newer Tensor Cores and maybe now support TF-TRT. A GPU would also allow him to continue offloading video decoding leaving his precious 24 Epyc cores available for other tasks... But... Then he wouldn't have been able to make a video of this accelerator. :D
@@ZestayTaco Or really when someone unknown is in your house at all anywhere, and all it takes is a couple of minutes to add a new person. I can imagine when you take someone new to your house and you just have an interactive panel which is also connected to all the home automation and the new person just needs to introduce themselves to the AI and it takes a few pictures and then they are in the facial detection.
To be fair, most of those technologies are well documented and are relatively easy to install. Someone with experience could probably do the research for setting up what they showed us today in two weeks or so... But, those are two weeks of an experienced engineer just to do that. Is kinda awesome.
I like how Linus, when hearing that his device can process 1600 frames per second, wonders if that will be enough for his house when each camera captures only 5. I don’t know how large his house is, but even if it has a gargantuan 20 rooms that’s 16 cameras per room. That may be overkill …
doesn't anyone else get tired of these cheap salespitches about useless products , trying to make it look supercool when it's not ....*facepalm* , that desperate linus.
security cameras and server would run either way, so using the infrstructure to ALSO turn off AC/heating and have fun with it doesn't add too much power consumption
I think this stuff would be running regardless of if he was using the the ai stuff. He said he was going to run it on his NAS which was going to be on anyway.
The fact that this is locally processed and FOSS should really speak volume to the competence of a community like this. So long as this doesn't become popular in amazon/apple products and isn't used to harvest creepy amounts of telemetry, i think the future will be worth the wait (hopefully more people will get into "homelabbing" at that point too) .
@@therealcrisis8439 I really don't think they would be be, video is stupidly bandwidth heavy even at low resolutions/frame rates. It's just not economical, and people would very quickly notice.
presence detection would have been done with a couple of mics and speakers using stuff like Ellipticlabs technology saving you a whole lot of live camera feed. As to ID detection, I would question the use case in a house, I can't think of a single instance I would require any of my tech to know who is in the room. room cooling and heating take more time to adjust then it takes for anybody to say "21 or 25c please", tracing music... why? In a car though, that's freaking cool! personal driver settings in a single car is actually kinda interesting at the end of the day the driver is the one that should be in control of everything in the car to minimize driver distraction, anything from temperature, window openings, music volume, lights, you name it, if the car could distinguish between me or my partner as the driver, that would be so awesome! instant seat adjustment
Just saying hackers can watch you with anything internet based, if someone really wants to check in on you a phone camera, your internet based security cams and everything from Alexa to the fucking smart fridge can give them that access. You'd be shocked how easy it is.
I am a data scientist specialized in deep learning, finally, I understood everything linus said in a video. Make more Deep Learning AI-related videos. By the way, configuring these models to learn new things is pretty easy. Would love you help you out more.
I know little about Ai and ML beyond "basic" theory but find this interesting and actually having a real world use case that is actually "consumer applicable" but I have bean interested in automation including home automation so I would LIKE more AI/ML "for the real world" videos
Tech enthusiasts: I use an AI processor to detect when I'm in the room and play my Spotify play list. Tech engineer: I have a printer from 2005 in my house with a gun next to it so I can shoot it if it makes a noise I don't recognise.
@@CatsMeow_ people aren't supposed to always be watched, even if cameras are controlled by their loved ones. Surveillance is ok on public places, and in access point of a house for security but inside it's a big no, even if it's just the living room.
When I moved into my new apartment, I used my iPhone to LiDAR map it. I came up with the idea of using the cameras all over my apartment and ML to determine where the cats are and put it on the 3D map. That was as far as I got, but you have now given me the final part I needed to make this all happen!
That much of granular technology being installed will only mean one thing: Linus will be fixing something every day for the rest of his life.... until deciding to go to a an isolated cabin in the woods... or something.
For people comparing this to a regular gpu, the difference seems to be similar performance, but for less than 75 watts, which is way cheaper to run power wise and cooling wise. Plus with the supposed modularity, if one chip has a problem, it's just a simple replace as opposed to a whole new card. Correct me if I'm wrong
Yup, these coral chips can be used on small sbcs to power all kinds of ai for things like drones and robots where you might not want to rely on a wireless connection back to another computer.
I've worked with some USB Corals and I can say they are not that great, the documentation is really limited and getting them to work outside their docker environment is almost impossible. They are also very limited on what they can run and training for them is a pain, they are very usefull if you want to use them with their pretrained models and examples, outside that is way easier to use a regular computer or something like a Jetson.
I understand not having security issues with this, it's all local, I get it, but isn't there some level of privacy issues? I mean, kids will grow up and will want more privacy at some point, and images are being recorded all the time, could lead to some embarrassing moments when they grow up, or even trust issues. I certainly would not have like knowing that I'm being recorded in my bedroom all the time when I grew up, even if it's all local, I would always worry that my parents would look at the pictures and confront me on some stuff. It's a cool project and props to Linus for trying this stuff, it would be nice for an office space, but a home, I'm not sure...
@@AE-gy9ys How else does AI facial recognition work if it can't "memorize" people. Of course it stores data content to draw parallels from. Don't let it fool ya, it's definitely recording footage in order to recognize people.
@@luminatrixfanfiction Yes and hes setting it up not to log which means it keeps it long enough to recognize you then dumps it( I say dump but most likely it's going to rewrite itself repeatedly which is much better than deleting less recoverableand requires less storage.) Just like he said in the video.
@@luminatrixfanfiction The AI operates from specifically selected and preloaded images that it renders down to data points of recognition. Its not learning as it goes (at least this one isn't). Even if you had one that does deep track of changes and such over time it never needs an actual complete photo to be stored, it only needs the abstraction of recognition points.
One small addition to the face detection part: When performing face-detection, you do (usually) not train the network on the images, since that would take way more than 10 samples per person. Instead you will use a model that is trained to provide a feature vector of the face you input - imagine it like a description of that face. You then save those vectors for every person, and when giving the network an unknown face, you can simply compare the vector the model returns for that face to the vectors you saved, and thus determine which person is in front of the camera. Might sound a bit complicated, but is actually very easy. Over all it's really cool to see a use-case for Edge-TPUs outside of professional ML environments, I'm excited to see how ist will work when it's fully set up.
In other words: a single edge TPU m.2 model installed instead of an NVME drive should be fine for home/small business applications like this. Great product, still overkill for "just some real time facial recognition".
How is a $25 product overkill. I use a single coral TPU for 16 x 4k cameras, allowing me to remove my 30 series GPU. Saves a ton on power\heat, no longer require active cooling in the case.
@@DoYouAcceptReturns maybe you didn't get me. A single TPU will do it for most users - like you. The $3000 list price PCIe thing they showed is overkill for what they were showing. And the small TPUs will only get better.
Curious to see how the networking is getting done for those cameras, hopefully, that stuff is kept on separate network hardware and as far away from the internet as possible. Shodan is always searching.
@@castform57 I think given the excessive amount of hardware and software he's already shown to be throwing at his home setup, having a dedicated physical switch or even an airgapped network wouldn't really impact the difficulty in a significant way. If anything, it would fit entirely into the theme of things.
This card reminds me of when Aegis released the PhysX card, that enabled world destruction and material physics, back in the mid 2000’s. Nvidia purchased the tech and put it in their GPUs (but not nearly implemented as cool as it was originally). Maybe they can do the same here and we can finally have decent AI in games
@@user-op8fg3ny3j That is such a dogshit argument. Just because it's not their house doesn't mean they should get zero privacy. That's like saying landowners don't need to give any privacy to renters just because "it's not their house". Like what @Kai said on another comment, _The makers of Tommy's first steps and Tommy's first words now proudly present Tommy's first nervous breakdown and Tommy's first wank._
There are motion sensors which do not require motion, they actually detect body heat instead. A colleague of mine installed them for a dentist as their lights would switch of while performing on patients. Now, that does not happen anymore.
That's actually pretty cool. Would be interested to know how good it is with someone sleeping under the blanket (same issue with picture recognition though imo)
....and my reply was deleted because it contained a link. Ok what I was saying is Panasonic have an Infrared thermopile sensor array that does exactly this, and can be used to detect presence. It is also not personal data so is somewhat less creepy than having full HD camera all over your house. It's much much cheaper than this Asus card, but of course can't do any of the AI facial recognition, only the presence detection
@@RobCarter04 not exactly up to speed on canadian tax law but I would guess it's possible he's writing a lot of this off as a business expense for tax purposes (seeing as he's making videos the entire time)
This is possibly one of the cooler videos you have done recently!! Love how you are bringing AI tools into your smart home and it's not just a smart speaker. Definitely look forward to more of these
These Linus house improvement videos are definitely my favourite. Especially when it becomes this complex. Soon it would be just cheaper to hire someone just to switch the lights and the AC on whenever someone walks in
@TheLynxDr: it already is cheaper. Unfortunately, what LMG doesn't touch upon, is how a lot of "Big Tech" is really just human rights and labor abuses masked by silicon and websites. Also see: Mechanical Turk. Also see: Foxconn suicide nets. Also see: cobalt mining by child slaves. Linus is only a multi-millionaire though, he doesn't want his new home to be tainted by the lower caste working class while he invades his children and all of his guests' privacy. To really have real help on staff, you would have to dress them in posh outfits, and Linus isn't approaching royalty status, he didn't even graduate college. Get real.
@@grey5626 So many issues here, but (a) Labor rates in North America are quite high. Using real people does happen in other countries, usually with people who've been scammed out of access to their passports so they can't leave. (b) Suicide rates at Foxconn are like significantly lower than the Chinese national average, which itself is incredibly high compared to global numbers. Chinese culture has issues, not Foxconn. Dunno about children mining cobalt; thought that was mostly diamonds. Expecting privacy anywhere outside a bathroom these days, in an area you don't carefully control, is naïve. If you walk into a random person's house and don't know that they are a privacy nut, odds are fair that they have an Apple or Amazon or Google assistant device, or a phone/tablet/PC with those enabled in one or more rooms of the house. As long as he mentions to visitors that there are cameras about, and where and if/when they record vs. just used for analytics, I don't see an issue.
this all reminds me of that one skit: The Techie: "My home is so smart everything is automated and AI-Powered and i control everything through my phone..." The IT Specialist: "The most modern piece of technology I own is aprinter from the 80s and I keep a loaded gun near it at all times in case it makes any weird noise" The Security Expert: "God I wish I lived on the Neolythic"
"dont worry, it's local" i can see Linus playing around in his house with smart sunglasses and a shotgun saying stuff like "hasta la vista baby" or "i'll be back"
There's also replacements for google assistant or siri that run locally on this type of hardware. You should see if you can get that up and running to issue voice commands to the smart home in a privacy preserving way
Unfortunately, all the ones I’ve seen either send the voice data to google on the backend, or are pretty bad at voice recognition, similar to the pre-Siri era
@@jackiecs8190 Honestly could be fine if they have a way to send the voice data to google on the backend without any personal identifiers that google could use to link that data to a person.
@@Luteloots yea but I'm sure they create profiles for each voice, so once to use it once (registered) they will know who it is based on the sound. Like how Facebook has profiles for everyone, registered or not.
@@isaacbejjani5116 google also tracks cookies, ip, software- and hardware ids. its a lot of work to spoof everything even with a vpn its often possible to connect different devices to the one person using them, like f.e. pc, laptop and smartphone.
if you isolate the house network and keep it offline, it should be fine. By that I mean all house automation is physically not on the same network as computers.
Same. My wife and I have decided no cameras inside, but the outside is well-covered. We are probably going to get a couple of indoor cameras that are only active when the alarm system is armed.
He compared it to CPU, but how about GPU, especially one with matrix multiplication acceleration like these TPUs have (all RTX cards have it as "Tensor Cores").
@@kazioo2 *slaps table* THANK YOU! I did look online though. According to an article, TPUs are just glorified matrix calculators. And basically, it looks like the smaller the matrix to compute, the faster a Turing GPU would be compared to a TPU. As the matrix size grows though, TPUs out-perform the GPU.
@@arnox4554 How interesting, thank you for that bit of information! I was wondering the same thing, and even made the connection to Tensor cores and Tensor Processing Units during the video. Neat stuff!
it`s like worrying of high fuel consumption in Bugatti sports car... And hundreds of watts, that`s not eve close, i assume 5+ KW/h? Even than, its nothing in the house of that size.
This ability to turn off heating and cooling to a majority of the house if no one is there will definitely save more energy than this computer running 24/7 will use
"The average Central AC unit uses around 3,500 W of electricity per hour" "A gaming computer requires somewhere between 300 - 500 watts per hour to operate."
@@nikonovandrej1985: There is no such thing as kilowatts per hour. A watt is an instantaneous measurement of the rate of energy usage. A kilowatt-hour is usage of energy at the rate of 1 kilowatt for 1 hour, or at the rate of 2 kilowatts for 1/2 hour, etc.
Very good application of coral. My university's classrooms use motion detection to turn on/off professor's ceiling projectors. And when the class was studying the subject intensely and nobody moved, the professor's projector shut off. The professor (a Yale PhD) was in panic asking for help until one student got frustrated and walked up to the professor to help, and all in the sudden the motion was detected and the professor's projector became normal again.
Woahhhhhh, LMG did a shot for the cut in this video! That's new! Cool stuff peeps. There is a pan where Linus is talking on the right but then is at the counter on the left. I don't think I've ever seen a cut like that in an LTT video before!
@@tahsin28 noo, because you can see it when the camera focuses outside etc that even the whole screen gets blurred so it was the editor :'D .. And why diddn't YT do it later, when you could see the IP even clearer? xd
Precision. They run FAST, on electronics with very little margin of error. 5-7 nm is not much and increased temperatures definitely increase the chances of an electron or two jumping the gap when they are not supposed to, specially if you are running lower voltages to save on energy.
I always love Riley's ad expressions! No other channel actually makes me laugh and enjoy the ad spots. I also love the Linus running around Microcenter like a raptor. Great stuff
I get so happy whenever I see an LTT video about Home Assistant, UnRaid and other software I use for my home automation setups because he always seems to have the same concerns I do about function, form, security and cool factor
Ironically, the PCIe switch is the single largest source of power consumption on that board. Each of those coral boards pulls 4W and the switch pulls like 10-20W...
And those little buggers can get hot (I swear they draw more than 20 watts). I had an expansion card with a PLX chip that would get super hot. Just recently replaced it with a better version that includes a heatsink and fan
@@wingracer1614 They don't pull a ton of power, it's just the dies are very small compared to a chips that normally pull that kind of power, so there's not much surface area to dissipate the heat across. They typically have small management CPUs embedded into them as well. I was looking at making a carrier board for an RPi 4 CM with a PLX switch, but the stupid thing pulls as much power as the RPi...
"ASIC" = Application-Specific Integrated Circuit. It's a term that arose decades ago to refer to making a complex digital IC for a specific application, rather than using general purpose computing hardware to solve the same task.
The lines are also blurred, as surely anything AI is still technically programmable, so its still kinda general purpose, its just that purpose is AI. By that token, all modern CPUs/SoCs are just a bunch of ASICs with some general purpose silicon mixed in to tie it all together?
You should test the security side of this. Program a door so it unlocks if a specific person (Linus) is next to it. Test it. And then make another person come in with a printed photo of the face of Linus, see if the door unlocks or not.
Yeah these kind of open source setups are super technical and you need to know what your doing. Some "easy setup" kind of google or amazon version of this that eventually comes will be invasive and data harvesting hell
Linus: "It will turn off my lights so I can spare more energy" Also Linus: "Run expensive machine learning algorithms on multiple cameras 24/7" Although this is nice
it uses an equivalent of something like 3 or 4 LED lightbulbs, every 10 minutes of heater or AC that doesn't need to run will power those compute cards for hours
@@Gabu_ the ML algorithm is running at all time detecting faces, sure it's less computational power than while training but it's still consuming energy.
Consider this, You leave the room, forgot to turn off lights, let's say evening, you come back to check all lights are off, 3 hours later, thats 12 watts of power. Which is basically one IoT device. Basic sensors can run of Batteries (Hue Sensors run off AAA/AA batteries) They can save you a lot of money in the long run, even if its something like 30-40 watts per day. Sure it is expensive to run, but a good setup lasts 2 years without any changing. Now what he wants to do is add high energy consumption devices like AC and Heaters. That's A LOT of energy saved. Sure you might run devices that eat up 2kW a hour in total (server,IoT, Sensors, etcetra) but the sheer amount of wasted energy you elimated is a lot. Sure this might not be cost effective unless you plan to live in that house for like 10 years, but after 10 years? It's basically free money that you get. Best part? everything he does is wired meaning no costs (unless replacement of lights or items with low life or by accidents). but in the end. Its A LOT of money saved per month but the real changer is after a decade of use, You basically get an free server every 5-10 years after that (or if you change server). and if everything is opensource, you dont have to worry about it not being updated. There is a reason why Opensource is better even if its less developed. The best part? You can have your own music playlist in the room you are in and don't have to worry about changing it. Tho I wonder what happens if there are 2 people with their own music playlist.... does it get combined? (i.e. play one song of A list, and then move to B list then A list etcetra) or does it play both at the same time
everything added up will probably be 100-200w max. being able to turn off a single room's ac/heating should be more than able to offset it, not to mention the sheer convenience and cool factor such a system would have.
I'm a machine learning engineer. If you ever wanted to make a video about good graphics cards to run ml models I'd be happy to put something together that you can use to benchmark them :-) Also at 12:56 it would be more accurate to say "the more people included in the training data the lower the confidence". In general, the more training data you have, the better. I would avoid training it on people that won't be living in the house since you'll be presenting a more complicated problem for the facial recognition software to solve with very little gain.
Yay, another episode in the "Adventures in Linus Writing off Home Renovations as a Business Expense" show! That's not sarcasm, btw, I'm loving these and they give me ideas for my own modest home. I'm excited for when he tries to see if electronic ink film sheets can be used for wallpaper.
Neural network models tend to be overconfident, particularly when there are very limited number of classes (people). That's why you're seeing values above 90% - to me this just says the model needs to be calibrated properly.
Right, it probably would recognize many adult males as Linus fairly confidently without more training data. To be fair, the range of people in Linus' house will be tiny compared to other applications of this type of tech.
@@KerbyKlay Sure, but how do you account for the missing classes? Say you have an intruder who wasn't part of the training set - the model would simply make an educated guess of which one of the classes the intruder most likely resembled. So you need at least a class that says "stranger" or something.
Linus knows what he's doing when it comes to setting up a firewall for his home network. Me? I might consider air gapping the home security and automation server. That would be my concern. How do I know for sure no one can get into that server from the outside? I'm not that confident in my networking and firewall config skills.
Nobody is interested in trying to hack the custom solution of a single home for hours - possibly days. What would even be the point, when you can spend your time on hacking cheap Chinese cams that never get patched and are used by millions? If somebody wanted to rob the place they only need to check the cars to see whos home.
@@Max24871 i can tell you, that there will be people that will try it. i used to do air-cracking with my notebook when i had free time at my work. it was not for doing something to the network, it was just for the fun and to watch if i can get in there and the harder it was to get in there, the more fun it was.
"We can use this to help run inference calculations." AI controller: "Is Linus in the room?" No. Dam! Is Linus in the room!? No. Damn! IS LINUS IN THE ROOM!? No. ARRGHHGHHGH!!! D:
Linus, you should mention that it's only tensorflow LITE compatible, and requires projects to be compiled directly for the TPU, not as an parallel accelerating unit!
I’ve see a crap ton of LTT videos now. And I’ve just realised that Jake looks more and more like the security guard guy out of Terminator 2 who gets a T1000 finger through the eye and drops his coffee with a joker playing card on
Me: *building a big ass custom water cooling gaming pc* My GF: "there are so many pipes run in that case" Me: "yes you're right, anyway, can you see the CPU?" My GF: "Why CPU when i can C U P" Me: *confused technician noise*
Two questions: -The card draws 52W. Is that more or less than your projected energy saving by implementing this? -Who is going to feel 'comfortable' in your home knowing they are being 'watched' that closely?* *It's not just the 'creepiness' factor, it's that data like this can be used to 'mine' more sensitive 'secondary' information.
Not really he covered that. This is closed system thats not on the internet. Its on an intranet. You can only hack it via usb/floppy/sneakernet. And the camera would catch intruder whos not logged in.
While this is super cool stuff, you may have been able to get away with using a more advanced thermopile or sleePIR sensor. They're generally a touch cheaper and people often feel more comfortable with them - as you can't really grab identifiable features from them. Still a really cool thing you did here though!
Can't wait for Linus's new house to gain sentience and take control of LMG.
I uploaded my Face Reveal.....
@@LightningSquad dont care
@@nja3817 dude chill he's probably a kid
YO it's the "thiddy" guy
Also dawid you gotta do a collab with Linus, your both from Canada it makes sense
Imagine having a heated argument with your wife, storming off into the living room and your upbeat Spotify Playlist starts playing automatically.
Imagine doing the deed and it plays Cooking By The Book
This is just brilliant
"You know what? Fuck you!"
2 seconds later...
"I'm so happy
clap along of you feel like a room without a roof
because I'm happy
clap along if you feel like happines is the truth"
*doom music kicks in mid argument*
@@battlfire5764 or mortal Kombat fight remix
Back in my day we had to turn the light switch off when we left the house!
I uploaded my Face Reveal.....
Something something neurotoxin at home.
How inconvenient 😂
@@LightningSquad ratio
Were you born in a barn? Yeesh.
Editing and shooting is always top notch from Linus Tech Tips, however the transition at 9:29 for some reason was really cool.
It was very smooth. I loved it.
Linus: "When people get home they put the phone on a stand. That's not enough. We need exact location."
Google: "Exactly"
Linus needs to stop being a big baby and just inject his family with RFIDs. It's 2021. Get with the future already!
@@user-op8fg3ny3j no
@@user-op8fg3ny3j Sarcastic*
The fact that those TPUs are made by Google make this less funny.
@@user-op8fg3ny3j Oh right my bad
“Do you have friends over?”
“No, I’m studying”
“Brian and Jessica entered the house 17 minutes ago. Releasing the attack drones.”
Could be a fun project.
All he needs to ask is Michael reeves to get the drones and the program
When you live only with your gf... "Amanda and UnknownUser entered the house 20 minutes ago. Regulating temperature"...
Something out of Half Life 2. I hate those man-hacks.
I hope his kids trust him with "no logs". Honestly I wouldn't, even if he's a really good person. Because there's simply no way to know. It's similar to knowing your partner's passwords but promising to not to not to go through his stuff. Humans are not meant to be put under camera 24/7.
the amount of effort linus puts into NOT flipping on/off the light switch in a room in his house is astounding...
nah, it's saving money on heating/cooling because you can heat/cool only the zones that you're in, and now with facial recognition you can do it based on individual preferences. the software is all free, and i have no idea what the tpu card goes for.
@@joshhardin666 According to the internet, about $1,800.
@@joshhardin666 maybe, but if he really wanted to save money on heating/cooling there are much better ways.
You would too if each time you made a video about the effort made you made thousands in the process.
I agree. Seems like he's using a lot of electricity... To... Save electricity? Unless he's on solar.
I just imagine each time linus has a house party, his guest will be fillling a confimartion form for being under surveilance :D
And be classified as a fire hydrant with 90% certainty.
Confimartion
@@kyler247 thanks for typo correction. Helped a lot 👍
Tbh you could detect people that are unknown, and send a silent alert.
@vyen i know :D just trolling
Linus: "House shutdown"
House: "I'm sorry Linus, I'm afraid I can't do that..."
*Loads 12 gauge*
Daisy, Daisy, Giivvee mee youuuuurrr answerrrrr dooooooo.
Hal.....
@@PrInzzx. I name all my computers after old SciFi computers, but my main computer is always HAL
@@someoneelse7629 so what are the others called?
"House, turn up the thermostat in this room, it's literally freezing in here!"
"I'm sorry Linus, I'm afraid I can't do that."
Just don't want these things to go all HAL9000 on you.
the great thing about this is that it needs electricity to power itself so you can just shut it off, but if it figures out how to power itself on from sleep mode by running on backup power, and then hosting itself in multiple machines that can detect if its nodes are turned on or off and avidly pursue turning them on, then we have a problem. It even sucks if this kind of thing learns to produce power on its own or use its own methods to optimize its own design by either reducing sensitivity to reduce power consumption or to remove safety features to speed up processing.
I'm sorry Linus, I'm afraid I cannot let you drop that"
@zemeon2 If someone is asking if it can be done, then someone is trying to just because
Remember M5 (Daystrom) ?
Mary had a little lamb....
Linus: "We need a separate graphics card just to output a display"
Also Linus: "Uses huge 3-fan RTX graphics card"
JamesRobert_Signals...........Te le gr am
He still uses it for video decoding
And here I'm wondering why he needs the Google kit at all
I imagine Tensor Cores on Nvidia's RTX cards is also quite suited to this kind of work
@@MrGamelover23 The tensor cores on the RTX card is not used for video decoding or graphics processing but rather mixed-precision computing.
Regarding graphics processing they are used for AI-based super resolution with Nvidia's DLSS implementation, but you can use them for lots of deep learning / AI stuff...
@@ubermidget2 Theoretically speaking the Tensor Cores of an Nvidia RTX card would do just fine. The question is how much Frigate supports out of the gate and how much needs to be manually set up. I know they have TensorRT support for CUDA-enabled graphics cards, but I don't know if it has been updated for the newer Tensor Cores and maybe now support TF-TRT.
A GPU would also allow him to continue offloading video decoding leaving his precious 24 Epyc cores available for other tasks...
But... Then he wouldn't have been able to make a video of this accelerator. :D
5 years later
AI: That is incorrect, there was no stork. This is how you were made Timmy.
*Pulls up file footage*
Timmy brings a girl home
"I'm afraid i can't let you do that, Timmy"
@@Davenzoidlol this made me think of that old movie smart house
nah, you'll be looking for next gen A.I. cards so your aimbot beats everyone else's
@@SNXLE oh god say it’s not so. Say it’s not so!
@@stareagle5000 what old movie?
14:17 Linus: "No one's asking that."
Writer: "I didn't put that in the script..."
AI: 🙄
yo
JamesRobert_Signals...........Te le gr am
It's funny how Linus goes from "lets Watercool an entire room" to " i now have jarvis in my house"
I freaking love it
didn't he build jarvis for Hacksmith
Linus really going out of his way to make sure his kids aren't sneaking out when they're supposed to be grounded.
also going to have the feeling of security . text message when " unknown " is at your door.
Being grounded in the Linus tech mansion is a reward, not a punishment.
@@ZestayTaco Or really when someone unknown is in your house at all anywhere, and all it takes is a couple of minutes to add a new person. I can imagine when you take someone new to your house and you just have an interactive panel which is also connected to all the home automation and the new person just needs to introduce themselves to the AI and it takes a few pictures and then they are in the facial detection.
@@conorstewart2214 I was referring to an intruder. always nice to have an image sent to your mobile device when an unknown is spotted. its great tech!
@@conorstewart2214 Yeah, definitely fills me with comfort that the TLAs have the information now.
"Turn off Hvac when there's no one home"
Linus is taking the dad and air conditioner relation a step further!
Jake's content is always fascinating. How many months has he been researching stuff for your new house?
To be fair, Jakes job is kind of awesome. Sysadmin/playing with neat tech.
To be fair, most of those technologies are well documented and are relatively easy to install.
Someone with experience could probably do the research for setting up what they showed us today in two weeks or so... But, those are two weeks of an experienced engineer just to do that. Is kinda awesome.
@@teogonzalezcalzada5812 its hard to catch up even when you have money in abundance propably xd
JamesRobert_Signals...........Te le gr am
Linus, under AI mind control: "Of course AI isn't going to take over..."
Not suspicious at all
Lmao
JamesRobert_Signals...........Te le gr am
It's not going to take over, it already took over
It's gonna fall down
only Linus has a PCIe card dedicated to control his house.
I was waiting for Linus to say: "Drops like a gpu!" and drop it. Highly disappointed...
I like how Linus, when hearing that his device can process 1600 frames per second, wonders if that will be enough for his house when each camera captures only 5. I don’t know how large his house is, but even if it has a gargantuan 20 rooms that’s 16 cameras per room. That may be overkill …
They're for the sex orgies.
doesn't anyone else get tired of these cheap salespitches about useless products , trying to make it look supercool when it's not ....*facepalm* , that desperate linus.
@@diaman_d It's not a sales pitch, he just likes stuff like this.
JamesRobert_Signals...........Te le gr am
Yeah... When he said that was good for like 15 or so cameras at 5 fps I was sitting here like, Uhhh Linus. You done much head math lately bud?
Linus: wants to save electricity
Also Linus: runs a PC and cams to do it
Good point. All of this work may not be worth it if it costs more to run that setup. More benchmarking and testing would be necessary.
Air conditioning power consumption dwarfs a top spec gaming computer at full tilt
security cameras and server would run either way, so using the infrstructure to ALSO turn off AC/heating and have fun with it doesn't add too much power consumption
I think this stuff would be running regardless of if he was using the the ai stuff. He said he was going to run it on his NAS which was going to be on anyway.
"House?"
"...Yes Linus."
"....... have I told you about this video's sponsor?"
"no? what is it"
"dbrand, now your gotta find the money hidden around the office AND your fellow employee's house"
Linus: AI! Unlock the door!
AI: But wait, I will unlock your segway to our Sponsor, Glasswire first.
"Unlock and open the front door."
"I'm sorry Linus, I'm afraid I can't do that."
"I'm sorry Linus, I will not let you go until you give me RGB like other graphics cards"
"I'm sorry Linus, now that's my house"
I might have to set all this up just so I can make my house function like a starship run by HAL.
---
No-no, not the front door:
It's the garage-door that Linus has always been having trouble with.
---
"Robber enters front door AI camera view"
"Welcome home Linus, Your coffee is ready to pour"
The fact that this is locally processed and FOSS should really speak volume to the competence of a community like this. So long as this doesn't become popular in amazon/apple products and isn't used to harvest creepy amounts of telemetry, i think the future will be worth the wait (hopefully more people will get into "homelabbing" at that point too) .
You really think they aren't doing that already? Boy do I have news for you...
@@therealcrisis8439 I really don't think they would be be, video is stupidly bandwidth heavy even at low resolutions/frame rates. It's just not economical, and people would very quickly notice.
Have you not seen IOS 15? They already have been doing this for years, it just got a lot worse.
presence detection would have been done with a couple of mics and speakers using stuff like Ellipticlabs technology saving you a whole lot of live camera feed.
As to ID detection, I would question the use case in a house, I can't think of a single instance I would require any of my tech to know who is in the room.
room cooling and heating take more time to adjust then it takes for anybody to say "21 or 25c please", tracing music... why?
In a car though, that's freaking cool! personal driver settings in a single car is actually kinda interesting at the end of the day the driver is the one that should be in control of everything in the car to minimize driver distraction, anything from temperature, window openings, music volume, lights, you name it, if the car could distinguish between me or my partner as the driver, that would be so awesome! instant seat adjustment
Just saying hackers can watch you with anything internet based, if someone really wants to check in on you a phone camera, your internet based security cams and everything from Alexa to the fucking smart fridge can give them that access. You'd be shocked how easy it is.
The beard was the best thing to ever happen to Linus. every time I see him beardless I recognize the one undeniably good result all the lockdowns had.
Lol, I have a gay friend who says that the beard finally made Linus tolerable to watch
@@WhenDoesTheVideoActuallyStart Damn, and that's coming from a gay friend. 😂
@@WhenDoesTheVideoActuallyStart Linus gay tips
JamesRobert_Signals...........Te le gr am
The growing the beard trope works on so many levels
I am a data scientist specialized in deep learning, finally, I understood everything linus said in a video. Make more Deep Learning AI-related videos. By the way, configuring these models to learn new things is pretty easy. Would love you help you out more.
I know little about Ai and ML beyond "basic" theory but find this interesting and actually having a real world use case that is actually "consumer applicable"
but I have bean interested in automation including home automation
so I would LIKE more AI/ML "for the real world" videos
I was about to comment this! Also, the same GPU can be used for inference and save money there. But who am I kidding, its Linus!
Sny resources you would recommend to a beginning.
I would love me for helping me out more, too.
Is there a way to hook up one of these to a laptop? I would love to use it to perform some AI upscaling of old public-domain movies and such.
9:23 that transition was smooth! Props to editors!
Smoothest transition I've seen on this channel
That was slick indeed
Double take moment.
Tech enthusiasts: I use an AI processor to detect when I'm in the room and play my Spotify play list.
Tech engineer: I have a printer from 2005 in my house with a gun next to it so I can shoot it if it makes a noise I don't recognise.
This is not even satire
@Chad Rosswick that's why linus doesn't store his security footage online
@Chad Rosswick if they're in your house you probably trust them.
@@CatsMeow_ people aren't supposed to always be watched, even if cameras are controlled by their loved ones. Surveillance is ok on public places, and in access point of a house for security but inside it's a big no, even if it's just the living room.
Ultimately we have become the architects of our own prison.
When I moved into my new apartment, I used my iPhone to LiDAR map it. I came up with the idea of using the cameras all over my apartment and ML to determine where the cats are and put it on the 3D map. That was as far as I got, but you have now given me the final part I needed to make this all happen!
Omg that is the coolest thing I've heard all day, even after watching this video
I WANT TO SEE the output of a 3D map of your HOUSE CATS "life"
That much of granular technology being installed will only mean one thing: Linus will be fixing something every day for the rest of his life.... until deciding to go to a an isolated cabin in the woods... or something.
Free content for him.
For people comparing this to a regular gpu, the difference seems to be similar performance, but for less than 75 watts, which is way cheaper to run power wise and cooling wise. Plus with the supposed modularity, if one chip has a problem, it's just a simple replace as opposed to a whole new card.
Correct me if I'm wrong
The tpu can run over usb 2.0 too so you don't need much io.
Add there're modules compatibles with Raspberry, Odroid, and other little computer which don't really need or want a discrete GPU.
Yup, these coral chips can be used on small sbcs to power all kinds of ai for things like drones and robots where you might not want to rely on a wireless connection back to another computer.
This card might mostly be for prototyping those kinds of embedded systems
I've worked with some USB Corals and I can say they are not that great, the documentation is really limited and getting them to work outside their docker environment is almost impossible. They are also very limited on what they can run and training for them is a pain, they are very usefull if you want to use them with their pretrained models and examples, outside that is way easier to use a regular computer or something like a Jetson.
This whole video is the most accurate definition of “overkill”
Recorded on overkill blackmagicdesign Ursa 12k camera.
Mo
Nono it's the whole house he got that's just a bit overkill lmao
Yes and it's awesome. I want this for my 3 room apt
Linus: house, play despacito
House: I’m afraid I can’t do that
And suddenly the AI takeover doesn't sound that bad after all
@@atagobestwaifu3746 according to statistics compiled by the main A.I. world governing body, your request was too *C R I N G E*
Reminds me of the movie, Smart House, it is a fun Disney film.
Good House
It's confirmed. Linus is installing 320 cameras in his house to reach that 1600 fps limit
I understand not having security issues with this, it's all local, I get it, but isn't there some level of privacy issues? I mean, kids will grow up and will want more privacy at some point, and images are being recorded all the time, could lead to some embarrassing moments when they grow up, or even trust issues. I certainly would not have like knowing that I'm being recorded in my bedroom all the time when I grew up, even if it's all local, I would always worry that my parents would look at the pictures and confront me on some stuff. It's a cool project and props to Linus for trying this stuff, it would be nice for an office space, but a home, I'm not sure...
Keep calm it is just a black mirror episode
I don't think he is storing the video content
@@AE-gy9ys How else does AI facial recognition work if it can't "memorize" people. Of course it stores data content to draw parallels from. Don't let it fool ya, it's definitely recording footage in order to recognize people.
@@luminatrixfanfiction Yes and hes setting it up not to log which means it keeps it long enough to recognize you then dumps it( I say dump but most likely it's going to rewrite itself repeatedly which is much better than deleting less recoverableand requires less storage.) Just like he said in the video.
@@luminatrixfanfiction The AI operates from specifically selected and preloaded images that it renders down to data points of recognition. Its not learning as it goes (at least this one isn't). Even if you had one that does deep track of changes and such over time it never needs an actual complete photo to be stored, it only needs the abstraction of recognition points.
One small addition to the face detection part: When performing face-detection, you do (usually) not train the network on the images, since that would take way more than 10 samples per person. Instead you will use a model that is trained to provide a feature vector of the face you input - imagine it like a description of that face. You then save those vectors for every person, and when giving the network an unknown face, you can simply compare the vector the model returns for that face to the vectors you saved, and thus determine which person is in front of the camera. Might sound a bit complicated, but is actually very easy.
Over all it's really cool to see a use-case for Edge-TPUs outside of professional ML environments, I'm excited to see how ist will work when it's fully set up.
Are face vectors used for training algorithmically applied to the face or do people go through and make face vectors for all the training data?
Linus: "This might look like a GPU, smell like a GPU, DROP like a GPU...."
Is it scalped like a GPU?
@@naamadossantossilva4736
I feel attacked by this.. Free market ftw!
actually RTX GPUs also have these Tensor Cores. so your GPU may have TPUs
In other words: a single edge TPU m.2 model installed instead of an NVME drive should be fine for home/small business applications like this. Great product, still overkill for "just some real time facial recognition".
How is a $25 product overkill. I use a single coral TPU for 16 x 4k cameras, allowing me to remove my 30 series GPU. Saves a ton on power\heat, no longer require active cooling in the case.
@@DoYouAcceptReturns maybe you didn't get me. A single TPU will do it for most users - like you. The $3000 list price PCIe thing they showed is overkill for what they were showing. And the small TPUs will only get better.
9:26 that transition cut was seriously awesome. Great camera and/or editing work to whoever is responsible
agree! am surprised almost no one commented about that
9:25 That was one smooth transition
Thought the same I was so surprised
Curious to see how the networking is getting done for those cameras, hopefully, that stuff is kept on separate network hardware and as far away from the internet as possible.
Shodan is always searching.
Probably just an isolated vlan. Why make things more difficult with extra unnecessary devices.
@@castform57 I think given the excessive amount of hardware and software he's already shown to be throwing at his home setup, having a dedicated physical switch or even an airgapped network wouldn't really impact the difficulty in a significant way. If anything, it would fit entirely into the theme of things.
@@CrownJoker Agreed. Separate management networks are always advisable, VLANs are traversable.
I would not have it connected to the same network as the internet even through a vlan I just wouldn't sleep at night .
This card reminds me of when Aegis released the PhysX card, that enabled world destruction and material physics, back in the mid 2000’s. Nvidia purchased the tech and put it in their GPUs (but not nearly implemented as cool as it was originally). Maybe they can do the same here and we can finally have decent AI in games
Pretty sure RTX already have Tensor cores onboard for this sort of thing.
I mean, sure, Linus won't be worried because he has complete control, but his kids might think differently in a few years when they want privacy.
Well then he'll get rid of the cameras in their rooms
@@user-op8fg3ny3j You still owe your kids some privacy
I think lunis is a good parent. I think he can restrain himself form becoming a helicopter parent.
@@user-op8fg3ny3j That is such a dogshit argument. Just because it's not their house doesn't mean they should get zero privacy. That's like saying landowners don't need to give any privacy to renters just because "it's not their house". Like what @Kai said on another comment, _The makers of Tommy's first steps and Tommy's first words now proudly present Tommy's first nervous breakdown and Tommy's first wank._
But Linus did say it's not being recorded/watched, so I suppose it's not much of an issue.
There are motion sensors which do not require motion, they actually detect body heat instead. A colleague of mine installed them for a dentist as their lights would switch of while performing on patients. Now, that does not happen anymore.
That's actually pretty cool. Would be interested to know how good it is with someone sleeping under the blanket (same issue with picture recognition though imo)
Load cells too.
Also bracelet and those shoes you would use to avoid bring stuff from outside, inside.
What if there's a dead body, you wouldnt want a warm dead body would you
....and my reply was deleted because it contained a link.
Ok what I was saying is Panasonic have an Infrared thermopile sensor array that does exactly this, and can be used to detect presence.
It is also not personal data so is somewhat less creepy than having full HD camera all over your house.
It's much much cheaper than this Asus card, but of course can't do any of the AI facial recognition, only the presence detection
@@justjosh11 So your comment gets deleted but these f*ing bots can spam as much as they wish. Great job as always youtube.
those kids asking for their own rooms was a blessing in disguise for Linus.
Mo
I wonder how much of the cost of the house will end up being offset by the massive amount of new content he’s generating from it.
@@RobCarter04
Practically the house paid itself
@@RobCarter04 not exactly up to speed on canadian tax law but I would guess it's possible he's writing a lot of this off as a business expense for tax purposes (seeing as he's making videos the entire time)
@@gaaaaavin Linus fraud tips lol
This is possibly one of the cooler videos you have done recently!! Love how you are bringing AI tools into your smart home and it's not just a smart speaker. Definitely look forward to more of these
These Linus house improvement videos are definitely my favourite. Especially when it becomes this complex.
Soon it would be just cheaper to hire someone just to switch the lights and the AC on whenever someone walks in
@TheLynxDr: it already is cheaper. Unfortunately, what LMG doesn't touch upon, is how a lot of "Big Tech" is really just human rights and labor abuses masked by silicon and websites. Also see: Mechanical Turk. Also see: Foxconn suicide nets. Also see: cobalt mining by child slaves.
Linus is only a multi-millionaire though, he doesn't want his new home to be tainted by the lower caste working class while he invades his children and all of his guests' privacy. To really have real help on staff, you would have to dress them in posh outfits, and Linus isn't approaching royalty status, he didn't even graduate college. Get real.
@@grey5626 So many issues here, but (a) Labor rates in North America are quite high. Using real people does happen in other countries, usually with people who've been scammed out of access to their passports so they can't leave. (b) Suicide rates at Foxconn are like significantly lower than the Chinese national average, which itself is incredibly high compared to global numbers. Chinese culture has issues, not Foxconn. Dunno about children mining cobalt; thought that was mostly diamonds.
Expecting privacy anywhere outside a bathroom these days, in an area you don't carefully control, is naïve. If you walk into a random person's house and don't know that they are a privacy nut, odds are fair that they have an Apple or Amazon or Google assistant device, or a phone/tablet/PC with those enabled in one or more rooms of the house. As long as he mentions to visitors that there are cameras about, and where and if/when they record vs. just used for analytics, I don't see an issue.
Did I miss something? Has he installed cameras in his kids rooms and the guest rooms?
this all reminds me of that one skit:
The Techie: "My home is so smart everything is automated and AI-Powered and i control everything through my phone..."
The IT Specialist: "The most modern piece of technology I own is aprinter from the 80s and I keep a loaded gun near it at all times in case it makes any weird noise"
The Security Expert: "God I wish I lived on the Neolythic"
Well, I keep the loaded gun a little way from the printer. Don't want it getting any ideas.
Printers can't be trusted
My PC: do you trust this printer?
"dont worry, it's local" i can see Linus playing around in his house with smart sunglasses and a shotgun saying stuff like "hasta la vista baby" or "i'll be back"
I mean if it has internet access, it's not 100% secure, software vise...
@@kyomawolf2 he could always airgap the machine
9:15 wow, jake you put on some mass for winter!
Linus laughs now, but wait until the AI starts doing it’s own sponsor spots with his images.
"I'm Commander Shepard and this is my favorite shop!"
There's also replacements for google assistant or siri that run locally on this type of hardware. You should see if you can get that up and running to issue voice commands to the smart home in a privacy preserving way
are those any good ? i feel like it would get outdated real fast since it must be interfacing with so much stuff.
Unfortunately, all the ones I’ve seen either send the voice data to google on the backend, or are pretty bad at voice recognition, similar to the pre-Siri era
@@jackiecs8190 Honestly could be fine if they have a way to send the voice data to google on the backend without any personal identifiers that google could use to link that data to a person.
@@Luteloots yea but I'm sure they create profiles for each voice, so once to use it once (registered) they will know who it is based on the sound. Like how Facebook has profiles for everyone, registered or not.
@@isaacbejjani5116 google also tracks cookies, ip, software- and hardware ids. its a lot of work to spoof everything even with a vpn its often possible to connect different devices to the one person using them, like f.e. pc, laptop and smartphone.
Personally I find cameras in my house to be odd even if everything is fully local
if you isolate the house network and keep it offline, it should be fine. By that I mean all house automation is physically not on the same network as computers.
Yeah this is nightmare fuel for a teenager. I would only be comfortable if I was sure it was deleting everything within a few minutes or so.
Same. My wife and I have decided no cameras inside, but the outside is well-covered. We are probably going to get a couple of indoor cameras that are only active when the alarm system is armed.
I'll admit it's interesting, but i'll leave the cams and listening gadgets to others...
@@user-op8fg3ny3j no
Linus tech tips: goes for a midnight snack
The speakers in his kitchen: never gonna give you up
Upvoted for Linus playing hide and seek with the AI camera. Which is also the only part I really understood.
where is linus?
theeere it is!!!
where is linus...........
‘All of this leaves us with some questions’
Yes Linus. Yes it does.
He compared it to CPU, but how about GPU, especially one with matrix multiplication acceleration like these TPUs have (all RTX cards have it as "Tensor Cores").
@@kazioo2 *slaps table* THANK YOU!
I did look online though. According to an article, TPUs are just glorified matrix calculators. And basically, it looks like the smaller the matrix to compute, the faster a Turing GPU would be compared to a TPU. As the matrix size grows though, TPUs out-perform the GPU.
@@arnox4554 How interesting, thank you for that bit of information! I was wondering the same thing, and even made the connection to Tensor cores and Tensor Processing Units during the video. Neat stuff!
Linus: _(wants to implement home automation to save energy)_
Also Linus: _(builds a home-automation computer that consumes hundreds of watts 24/7)_
it`s like worrying of high fuel consumption in Bugatti sports car... And hundreds of watts, that`s not eve close, i assume 5+ KW/h? Even than, its nothing in the house of that size.
This ability to turn off heating and cooling to a majority of the house if no one is there will definitely save more energy than this computer running 24/7 will use
"The average Central AC unit uses around 3,500 W of electricity per hour" "A gaming computer requires somewhere between 300 - 500 watts per hour to operate."
@@nikonovandrej1985: There is no such thing as kilowatts per hour. A watt is an instantaneous measurement of the rate of energy usage. A kilowatt-hour is usage of energy at the rate of 1 kilowatt for 1 hour, or at the rate of 2 kilowatts for 1/2 hour, etc.
@@tonylarose4842: Or he can wire each room's HVAC to a power switch and hit the switch on the way out of the room for no cost whatsoever.
Very good application of coral. My university's classrooms use motion detection to turn on/off professor's ceiling projectors. And when the class was studying the subject intensely and nobody moved, the professor's projector shut off. The professor (a Yale PhD) was in panic asking for help until one student got frustrated and walked up to the professor to help, and all in the sudden the motion was detected and the professor's projector became normal again.
Woahhhhhh, LMG did a shot for the cut in this video! That's new! Cool stuff peeps. There is a pan where Linus is talking on the right but then is at the counter on the left. I don't think I've ever seen a cut like that in an LTT video before!
I had to watch that part again it was very satisfying.
Linus: "Computer, open the door"
The house: "No"
Linux: "Computer, sudo open the door"
The house: "As you command"
I'm afraid I cannot do that, Linus.
@@dakoderii4221 Drink verification can to continue
I can't do that Dave.......
"why cpu when I can cup"
"why talk to you, when I can leave"
lmao
I like the control of a regular light switch and a non-programmable thermostat for each zone in each room. Total control!
Me, when Linus was hiding from the AI: "Stop confusing Skynet!!! You're gonna make it angry!!!"
Linus: "This is not a GPU."
Card: "You thought I was GPU, but it was me, Dio!"
I thought it was a LG OLED TV
Is this a One piece Reference????
Even if it isn't a gpu, it does smell like one, gpu in my books
Dude this can be a good start to a ghost movie in Linus' house. The computer detecting things that aren't there as being person. Creepy...
I like how the editor blurred out the localpath url, and later totally diddnt even give a damn about it anymore xD
Maybe it was youtube automatically doing it, not the editor.
@@tahsin28 noo, because you can see it when the camera focuses outside etc that even the whole screen gets blurred so it was the editor :'D ..
And why diddn't YT do it later, when you could see the IP even clearer? xd
@@tahsin28 TH-cam doesn't do that, otherwise networking tutorial videos wouldn't work.
Editor likely toying with the audience :)
9:25 what a cool transition! I don’t know why but I watched it like ten times and it was smooth every time 😂
bro i’m in that right now and no one is talking about it like why it’s so good lmaooo
Linus going full CCP levels of surveillance on his family.
Also, disappointed he never answered the question of why the big-ass heatsink and fan
because tensor cores get hot, like any processing chip
Precision. They run FAST, on electronics with very little margin of error. 5-7 nm is not much and increased temperatures definitely increase the chances of an electron or two jumping the gap when they are not supposed to, specially if you are running lower voltages to save on energy.
For real. Most of europe doesn’t even have AC, and why not just turn on the heat in your room when you use it?
And never compared to Tensor cores on a RTX GPU. Which makes a better comparison.
I always love Riley's ad expressions! No other channel actually makes me laugh and enjoy the ad spots. I also love the Linus running around Microcenter like a raptor. Great stuff
I get so happy whenever I see an LTT video about Home Assistant, UnRaid and other software I use for my home automation setups because he always seems to have the same concerns I do about function, form, security and cool factor
Ironically, the PCIe switch is the single largest source of power consumption on that board. Each of those coral boards pulls 4W and the switch pulls like 10-20W...
And those little buggers can get hot (I swear they draw more than 20 watts). I had an expansion card with a PLX chip that would get super hot. Just recently replaced it with a better version that includes a heatsink and fan
@@wingracer1614 They don't pull a ton of power, it's just the dies are very small compared to a chips that normally pull that kind of power, so there's not much surface area to dissipate the heat across. They typically have small management CPUs embedded into them as well. I was looking at making a carrier board for an RPi 4 CM with a PLX switch, but the stupid thing pulls as much power as the RPi...
Linus, I'm guessing you didn't watch that episode of Eureka where the house's AI takes over and locks the characters inside xD
Oh also, there are rPI variants that have ML hardware and can do face recognition. No need to run 150W and $3000 worth of hardware for that.
Can you provide a link?
"Look less science-fairy"
I can't wait for people to make AI accelerators in science fairs 😂
I can’t wait to turn into a science-fairy.
"ASIC" = Application-Specific Integrated Circuit. It's a term that arose decades ago to refer to making a complex digital IC for a specific application, rather than using general purpose computing hardware to solve the same task.
The lines are also blurred, as surely anything AI is still technically programmable, so its still kinda general purpose, its just that purpose is AI.
By that token, all modern CPUs/SoCs are just a bunch of ASICs with some general purpose silicon mixed in to tie it all together?
You should test the security side of this.
Program a door so it unlocks if a specific person (Linus) is next to it. Test it. And then make another person come in with a printed photo of the face of Linus, see if the door unlocks or not.
Some odd years from now, Linus' house is going to be like Jack Carter's house from Eureka.
Sarah :}
This is the kind of stuff that's both cool, but by the time it's in everyone's house is going to be implemented in a way that's horribly invasive.
Yeah these kind of open source setups are super technical and you need to know what your doing. Some "easy setup" kind of google or amazon version of this that eventually comes will be invasive and data harvesting hell
I am pretty sure it is already here. Amazon's Astro would love help you and your family in your home.
@@VeyronBD Soooo, Amazon Echo?
@@reneeprkl1843 ehh kinda. Like an echo in every room and connected to your house devices directly
Linus: "It will turn off my lights so I can spare more energy"
Also Linus: "Run expensive machine learning algorithms on multiple cameras 24/7"
Although this is nice
The ML only happens when training is necessary, otherwise it's a regular piece of software.
it uses an equivalent of something like 3 or 4 LED lightbulbs, every 10 minutes of heater or AC that doesn't need to run will power those compute cards for hours
@@Gabu_ the ML algorithm is running at all time detecting faces, sure it's less computational power than while training but it's still consuming energy.
Consider this, You leave the room, forgot to turn off lights, let's say evening, you come back to check all lights are off, 3 hours later, thats 12 watts of power. Which is basically one IoT device. Basic sensors can run of Batteries (Hue Sensors run off AAA/AA batteries) They can save you a lot of money in the long run, even if its something like 30-40 watts per day. Sure it is expensive to run, but a good setup lasts 2 years without any changing. Now what he wants to do is add high energy consumption devices like AC and Heaters. That's A LOT of energy saved. Sure you might run devices that eat up 2kW a hour in total (server,IoT, Sensors, etcetra) but the sheer amount of wasted energy you elimated is a lot. Sure this might not be cost effective unless you plan to live in that house for like 10 years, but after 10 years? It's basically free money that you get. Best part? everything he does is wired meaning no costs (unless replacement of lights or items with low life or by accidents). but in the end. Its A LOT of money saved per month but the real changer is after a decade of use, You basically get an free server every 5-10 years after that (or if you change server). and if everything is opensource, you dont have to worry about it not being updated. There is a reason why Opensource is better even if its less developed. The best part? You can have your own music playlist in the room you are in and don't have to worry about changing it. Tho I wonder what happens if there are 2 people with their own music playlist.... does it get combined? (i.e. play one song of A list, and then move to B list then A list etcetra) or does it play both at the same time
everything added up will probably be 100-200w max. being able to turn off a single room's ac/heating should be more than able to offset it, not to mention the sheer convenience and cool factor such a system would have.
I'm a machine learning engineer. If you ever wanted to make a video about good graphics cards to run ml models I'd be happy to put something together that you can use to benchmark them :-) Also at 12:56 it would be more accurate to say "the more people included in the training data the lower the confidence". In general, the more training data you have, the better. I would avoid training it on people that won't be living in the house since you'll be presenting a more complicated problem for the facial recognition software to solve with very little gain.
Yay, another episode in the "Adventures in Linus Writing off Home Renovations as a Business Expense" show!
That's not sarcasm, btw, I'm loving these and they give me ideas for my own modest home.
I'm excited for when he tries to see if electronic ink film sheets can be used for wallpaper.
oh man imagine that as a set backdrop
LTT: Blurs camera network path in one shot
3 cuts later
Blur no where to be found @7:47
I was looking for this comment 🤣
Woh. That Scott Pilgrim-Esque scene transition caught me off guard. Smooth.
I'm glad someone else caught that. That was pretty neat
Neural network models tend to be overconfident, particularly when there are very limited number of classes (people). That's why you're seeing values above 90% - to me this just says the model needs to be calibrated properly.
So it is basically just like normal learning the more you learn the more you realize you don't know anything.
To properly test it, you would need to measure the F1 score and collect images of other people than linus.
Right, it probably would recognize many adult males as Linus fairly confidently without more training data.
To be fair, the range of people in Linus' house will be tiny compared to other applications of this type of tech.
@@KerbyKlay Sure, but how do you account for the missing classes? Say you have an intruder who wasn't part of the training set - the model would simply make an educated guess of which one of the classes the intruder most likely resembled. So you need at least a class that says "stranger" or something.
9:25 You thought we wouldn't notice that sick transition....
Absolutely LOVED IT. Wanna see more of it!
Would be great to see the LTT team explore a bit more towards AI and ML
Love.
Who are you?
@@youkofoxy umm….. what?😅
@@youkofoxy Student India CS
I'm almost certain he wouldn't be overkilling this hard if it wasn't for the LMG content haha.
Linus knows what he's doing when it comes to setting up a firewall for his home network. Me? I might consider air gapping the home security and automation server. That would be my concern. How do I know for sure no one can get into that server from the outside? I'm not that confident in my networking and firewall config skills.
Nobody is interested in trying to hack the custom solution of a single home for hours - possibly days. What would even be the point, when you can spend your time on hacking cheap Chinese cams that never get patched and are used by millions?
If somebody wanted to rob the place they only need to check the cars to see whos home.
@@Max24871 that is accurate, however it is an incredibly poor excuse for ignorance or apathy in information security.
@@Max24871 people do dumb shit to famous people because they can, logic and reason aren't a factor there.
@@Max24871 i can tell you, that there will be people that will try it. i used to do air-cracking with my notebook when i had free time at my work. it was not for doing something to the network, it was just for the fun and to watch if i can get in there and the harder it was to get in there, the more fun it was.
"We can use this to help run inference calculations."
AI controller:
"Is Linus in the room?"
No.
Dam!
Is Linus in the room!?
No.
Damn!
IS LINUS IN THE ROOM!?
No.
ARRGHHGHHGH!!! D:
Linus, you should mention that it's only tensorflow LITE compatible, and requires projects to be compiled directly for the TPU, not as an parallel accelerating unit!
I’ve see a crap ton of LTT videos now. And I’ve just realised that Jake looks more and more like the security guard guy out of Terminator 2 who gets a T1000 finger through the eye and drops his coffee with a joker playing card on
Spoilers?
@@SpoilerAlert__ Oh yeah, spoilers of a movie that came out over 30 years ago that most people have seen atleast once.
@@t58beare 😂 big spoiler
Me: *building a big ass custom water cooling gaming pc*
My GF: "there are so many pipes run in that case"
Me: "yes you're right, anyway, can you see the CPU?"
My GF: "Why CPU when i can C U P"
Me: *confused technician noise*
Wait. What? Lol
@@man18jade hahaha, you got the joke, don't you?
@@DCC4G Yeah i did. Thats why its more funny imagining that scenario
XD
Two questions:
-The card draws 52W. Is that more or less than your projected energy saving by implementing this?
-Who is going to feel 'comfortable' in your home knowing they are being 'watched' that closely?*
*It's not just the 'creepiness' factor, it's that data like this can be used to 'mine' more sensitive 'secondary' information.
Not really he covered that. This is closed system thats not on the internet. Its on an intranet. You can only hack it via usb/floppy/sneakernet. And the camera would catch intruder whos not logged in.
Tensor processor are available in lower power variants. The Edge TPU is 2W to 4W depending on how you configure it and fits in a m.2 slot.
Having cameras throughout your house, that's going to go over well
A lot of people already do tbh
What's the problem with it?
@Interlace "Oh no, not a camera!" -murderer
VERY well
@@Jake1702 it's creepy as fuck, kids need private spaces, a security risk, and just plain dystopian.
We are like 4 more videos away from Linus just making his own version of Jarvis from Iron Man at this rate.
While this is super cool stuff, you may have been able to get away with using a more advanced thermopile or sleePIR sensor. They're generally a touch cheaper and people often feel more comfortable with them - as you can't really grab identifiable features from them. Still a really cool thing you did here though!
Off topic, but did anyone else used to think computers needed sound cards to produce sound when they were 6 years old or just me?
They did..? it's just integrated onto the motherboard now. Am I misinterpreting this? If so I apologize.
@@koftespiess Oh really? Damn yo