An update on Tesla's Dojo AI Supercomputer (AI Day 2022)
ฝัง
- เผยแพร่เมื่อ 27 มิ.ย. 2024
- Thumbnail image shared by social media, original author unknown.
Tesla's AI Day isn't for media, it's a hiring event where they try and get the best in the area to come see all the newest stuff the company is working on. So cue my surprise when I didn't see any other content creators there! I know @AnastasiInTech was invited but couldn't make it, and a number of investors where there, but hey, I count it as a win! In this video, I go over AI Day 2022, and the updates to Tesla Dojo, as well as talking about the silicon inside the Tesla Bot.
[0:00] Intro
[0:11] www.sifive.com
[0:50] What we already know
[1:25] What is AI Day?
[3:53] Tesla Dojo Updates
[4:23] VRMs and VRM Failures
[7:30] A 19kg Tile
[8:30] A Dojo Rack
[11:25] Timeline to Deployment
[12:45] Dojo vs Cerebras, according to Tesla
[13:58] Meeting the Dojo Team... and Security
[15:47] Tesla Bot Silicon
[18:45] Jobs at Tesla... and no why photos
[20:20] Cat Tax
-----------------------
more-moore.com : Sign up to the More Than Moore Newsletter
/ techtechpotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at / iancutress
Follow TechTechPotato on Twitter at / techtechpotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: • An Jone - Night Run Away
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #tesla #dojo
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Intel, Linode, MediaTek, NordPass, Qualcomm. - วิทยาศาสตร์และเทคโนโลยี
[0:11] www.sifive.com
[3:53] Tesla Dojo Updates
[4:23] VRMs and VRM Failures
[12:45] Dojo vs Cerebras, according to Tesla
[13:58] Meeting the Dojo Team... and Security
[15:47] Tesla Bot Silicon
[18:45] Jobs at Tesla... and no why photos
[20:20] Cat Tax
I think Tesla was more concerned with that Ian might be hiding one of the tiles under his shirt and running off. Enjoyed the content and thanks.
Or like Patrick of STH, that someone put one of the wafers in his bag without him knowing.... But a tile at 19 kilos would be a small gold bar's weight and Ian would return it, if mistakenly misplaced. He is a Brit gentleman, you know....
I think they trying to hide how little improvements they have made since last AI day.. Elon and Tesla are worried about stock price and want some +ve vibes around the stock.
Love your videos, studying computer engineering with a specialization in FPGAs right now and I love your insight on other areas of the industry!
I was waiting for this video! 7:46 envy! I hope we see each other at the next AI Day! :) P.S. I wonder which badge I would get ...
When I studied AI, neural networks, and neuroscience at college/university in the late 90’s, I envisioned massively interconnected custom “cube” chips with 3 dimensions of interconnects, purpose built for deeply layered neural networks. With stacked 2D massive interconnects in Tesla Dojo and Cerebras, we’re almost there. It’s a very exciting time!
This is just amazing. very well done, and thank you to tesla for letting the most interesting in-depth content creator in youtube!🎉🎉
Thanks for checking this out. More of this please.
i was really looking forward to this video to hear about your experience! thanks for being willing to ask tough questions. glad you got some answers and insights. good on ya, mate. great video as always!
"I was invited to Tesla's AI day"
The system works!!! \o/
I watched your preview/recap just a few days ago and hoped for this video go come a reality. What you shared on Twitter didn't sound too promising.
Nevertheless it's great to see this industry growing rapidly.
I see the Tesla-bot as a recruiting tool and “blue sky” development platform. The bot as a product is not the main payoff (at least not for a while); but the ideas sparked, insights earned, and challenges overcome will be phenomenal. Who doesn’t want build your own robot?
I've been thinking of use cases for the 'Bot. It hit home recently when I had an accident on my ebike and trashed one knee. I realize now just how much help a 'Bot could be in terms of self sufficient 'limited assist' living. For example, I can't carry anything while maneuvering around in my walker. So far, I have a little zippered mesh bag which I can put small, light items in and hang on a finger or thumb as I walker around. Having a 'Bot would allow me to say things like "Clear that shelf to this table" to remove all items from a shelf and have them placed on a table where I can easily work on them. Just having something able to follow me around and carry things that are too heavy or too awkward for me carry myself would be a boon. Think of all the otherwise physically competent people out there that have some sort of relatively minor physical impediment that could maintain self sufficient living with the aid of a Tesla bot. I suspect this is a much larger market than most people realize. This is especially true in aging population of single retirees.
This is a great take. Imagine all those people that have trouble getting help with mobility being able to access a bot like this, even if it was only part time. You could have a whole fleet of them roaming around to where people need them waaaaaay cheaper and more easily obtainable than people. That's not to take away from the ability of people, but it's a hard field to get people into and we'll understaffed.
yep it does make sense in a home/boutique assistance work but when watching the tasks they've assigned it in the presentation I was raising an eyebrow thinking that this can be automated for much cheaper, more reliably and faster with decades old solutions. I also think the android form factor is kinda detrimental and reduces the efficiency in many applications.
i ve been a quarter of a team that designed similar system and it was one of the biggest things i've done. So much fun :) watercooling insane hf interconnects, etc. it is fun to have 55A 0.85V supply line :)
Well done on getting a backstage invite pass, they knew you were the only nerd worthy…
I’m so happy that you were able to go 🎉. Do you know which version of the AMD chips were used? Rome/Milan etc
I didn't get that level of info, but it has to be at least Rome I'd assume
Awesome content ! Just discovered the channel and wish you to get more visibility soon.
I'm happy he listened, now make me understand more ;P
The thing you got to love about Elon is "The Information Wants too be free"..
: )
Hopefully we can learn more regarding the architectures of modern processors.
Just looking at the Tesla robot brain it looks like it doesn't run with a backup SOC in parallel, saving space and energy. 18:00
Nice :)
Great video. 👍
Awesome Video doctor ian
It's the same now in motor racing, eg, F1, MotoGP, etc. You can talk to mechanics/engineers/etc, but they are trained to never give you any technical info.
There is one smart reporter like you that can see changes from a distance, and he asks highly technical questions, ie, he goes to the team manager and ask why he raised the swing-arm pivot point 20mm.
One skill is to ask a pointed question in an indirect way. 'what would be the effect of elevating certain ride elements, such as this pivot point here?'
0:22 I always take a shape-shifter seriously.
Good that you mentioned the progress on the TeslaBot was a "miracle in of itself". Many youtubers completely missed it as if they were expecting an iRobot (The movie, no Roomba!) type Bot. The intention to be a "manual worker" is clear by the focus on human-like hands it has. And even progress at that was staggering. It appears that Tesla using their approach will hit their intended pricepoint within 3 years or a bit less. That would be almost a 10X reduction (in price) compared to anything any "conventional" robotics company is capable of. This would include Boston Dynamics (now owned by Hyundai). They are advanced in mechanicals, balance, articulation, agility but almost zero in AI.
TeslaBot will use its AI to optimise for every part of its function. This would include movement, balance, operating work etc. to optimise for battery life. And heck, it will plug itself in before critical shutdown!.
Elon needs to get you in as a personal guest like he does with Everyday Astronaut ❤ obviously lots will stay under wraps and you will only get to show a small amount more but I think that little bit more could be so valuable and enjoyable for all to see.
When is your start date ?
Why get a dishwasher when you can have a Teslabot doing the dishes manually :)
My childhood was watching the Jetsons and my retirement might be living in the Jetsons
exactly. Why using an expensive android running AI instead of using kinda low-tech solutions available for decades?
Something that I don't understand, if AI day it's a hire event, why don't 'use' the specialized content creators to spread the message?
They want to control the narrative. It's very common
The Tesla bot is more than enough for marketing. They’d rather save more spots for engineers.
Looks like Issac of ovillie!
Noice
Audio is a lil fuzzy sounding? Woolly
The system is not usable yet, the robot presentation was for distraction from that DOJO is not working. They probably have much bigger problems then it would appear on the surface.
No the robot was for free marketing. None of the stuff they showed about DOJO was supposed to be fully operational at the time. You misunderstand the nature of this presentation.
comeon skynet goooo
I think Dave from Tesla Daily was also there at AI day? 1:10
Rob from Tesla Daily. You're probably confusing with Dave Lee.
Where from the Dojo name comes?
The Dojo Supercomputer will be use for training neural networks. That is why they call them Dojo. It is a Japanese name for a room use for training martial arts.
So, can this AI focused Dojo be used for CFD and stuff?
I may be wrong but DOJO it's probably not directly compatible with current CFD tools/libs, but nothing prevents someone from training an neural net that's DOJO compatible to do a alpha-fold alike simulation/optimization. But then again, would need tons of data gathered from past sims.
Dojo primarily focus on half precision (16bit float). So they do not have good enough precision for CFD. It could probably do CFD but it will not be competitive against HPC GPU that has very high Double Precision (64bit float) compute.
@@kazedcat I see. Thanks!
Liquid cooling for all of that? Wow.
That robot looks like it's about where the Honda Asimo was in the 90s, hopefully the idea is to get engineers in to make it better.
Humanoid robots is a solved issue. What tesla is doing is making a mass producible humanoid robot and an AI brain. Two things that no one has ever done before. Both piggy back on their current manufacturing expertise and AI work for fsd.
@@_PatrickO It's certainly not a solved issue.
@@PhoenixMoonbeam Yes it is. Anyone can make a humanoid robot that walks around and picks stuff up. With heavy scripting, the robots can do any task a human can do. Tesla is making AI that allows the robot to do tasks by being asked and if needed, you act out the task so the robot learns it visually.
@@_PatrickO I'm going to assume by "anyone can" you mean "some people with the resources can" . It's very unreliable, we get to see limited demos of when it works well and it's impressive. I've only seen boston dynamics do any of the more advanced humanoid stuff and it's highly selective what we get to see. We're a long way from reliable robot butlers that can do generic tasks. I want one though.
@@PhoenixMoonbeam You are over thinking a simple thing and sorry, but that makes you stupid. How hard is it for you to believe your own eyes? Plenty of companies have made humanoid robots, it is no big deal. The issue everyone has is with a lack of intelligence, thus they never made a consumer product and never cared about mass production.
You can search youtube right now and see plenty of humanoid robots doing parkour. You can't find any company that gave their robot a brain adaptable to consumer tasks. Boston Dynamics sells their stuff with an sdk and it is up to you to program it to do anything.
Tesla is the first claiming to be developing an AI can that make a humanoid robot useful. By the time tesla sells these robots to consumers, they will be capable of household chores like mowing your lawn or cooking food. That is because tesla will work out basic chores in testing. Then on top of that, once they go beta, they can refine issues due to different houses and stuff. These things will be uploading video/data to tesla just like their cars. Its a feedback loop that will make them really good relatively fast.
Hi Potato, can you tell me why humanoid robots always walk with bent knees?
@@sirmongoose Thanks for replying. I still feel the robots could straighten their legs occasionally. As a skier I understand the need to bend your legs but we don't keep them permanently bent. Maybe one day when the tech improves, robots will straighten their legs, if only occasionally :)
They bent their knee to keep their center of gravity level. The way human walks is not actually energy efficient the up and down motion consume energy that is not applied to moving forward. We do not do the steady motion because our muscle would tire quickly but with robots they can actually lock their joints in a bent position so no energy is spent in maintaining a bent position.
@@kazedcat Ah I see. Thank you!
Does Tesla intend to sell time on Dojo as a service?
Musk has said a number of times that at some point in the future yes, however as it currently stands, the first gen has some limitations which means unless you get a full tile to yourself, it can't be shared.
Services will be done by twitter if he buys it despite all their fraud and shenanigans. Tweeting will be the free social aspect like gmail is to google that is supported by software services.
@@TechTechPotato Thanks for the info. 👍
To answer your question, EllieInSpace was another TH-cam creator who got invited 😜
I'm now seeing a small handful of content creators who went, although almost all of them seem to have a wide array of photos and videos to hand.
@@TechTechPotato "Dr. Know-it-all Knows it all" went and he has posted good interview discussions about it.
Anastasi also said she was invited late and couldn’t make it
Unless they can find an algorithm for reasoning they will never have truly effective AI. At the moment ANN's are really just like a reflex. That covers 99% of driving but sometimes you have to stop and think "What is going on here". Like GTP3, it appears to have a human like conversation but ask it what 1+1 is and it'll say 4(or what ever) because it doesn't really understand the question.
You can hard code it to have the correct response but then that isn't true AI and you'll never cover all those exceptions/outliers.
That doesn’t translate to basic perception space. There are entire fields of “correct” answers. This is just a field of gradient descents with a wide margin for error. That’s all that is needed to perform basic tasks. Tesla’s FSD and lane decisions combined with their occupancy network is essentially the full framework needed for a basic helper bot. I think what’s maybe missing is learning-by-watching. We need these bots to watch a human perform a task and then replicate that task. This would now be in the realm of general AI. Language models are not likely to be necessary to solve perception-action space with enough accuracy to perform useful tasks.
If any company does get self-driving working, there should be an obvious way to handle the 1% of unforseen circumstances: Blare the 'wake up driver' alarm. If the driver doesn't respond in time fall back to default behavior: Stop the car in the safest manner possible.
Marcus, you need to read up: th-cam.com/video/DfjUgFvHbTs/w-d-xo.html
"exa"pod
It's disappointing you need to ensure you get a future invite, it seems to be clouding your opinion of what was on display.
I think everything about the dojo is impressive but I refrain from buying tesla stock because of Elon's erratic behaviour in getting involved with politics and supporting Russia and China which is utterly absurd
He’s not supporting Russia. We need to stop labeling anyone trying to de escalate as Russian sympathisers. That’s how you get WWIII
I felt Ian wanted to say a lot more.. he kept his disappointment close to his vest. This was a media event.. it was to create a buzz about Tesla Innovation and cult of Elon, but there was nothing!
good question, why do you want no job at tesla? being a content creator can not be that prosper.
having a job at tesla is comparable with having some bitcoins, or having invested in apple in those days when a share was 7.50$
If you've seen my other videos, you'll know that being a content creator is something I do on the side
Keep on poking Ian
I wonder if Elon is going to have to give up his Telsa plant in China if he does not let them know everything about Dojo?
Dojo is a supercomputer and their plan is to install it in California.
Unlikely. The factory in China is fully private with Tesla. The state has no control or right to the corporate and company tech, nor do they have a way of obtaining it without multiple high level American employees selling to China.
Here's the update: Tesla Optimus is a JOKE. Its terrible. It looks worse than a robot from the 1990s. They're like 30 years behind boston dynamics or honda.
True, but I think what they show us within 5 years, might very well blow us away.
Their workflow explanations after the showing was very impressive.
That’s to you the layman. To anyone who understands the field what they were able to achieve with Optimus with so little time is extremely impressive.
@@meatsaucez1516 You don't know what you're talking about. It's not impressive whatsoever. All the hardware was off the shelf. The software is also all open source and has been done for over a decade now. A roomba is more sophisticated than this arthritic robot struggling to wave
@@Evolution56 I've seen better-moving robots built by hobbyists on youtube. Optimis is the 'sci-fi movie robot' - all style, looks awesome, but not remotely practical. It's a PR stunt model - something to wow the stockholders.
@@vylbird8014 If I was a betting man, I would choose Elon Musk being more right on this than you, but we will see.
Tesla bots Elon says be around $20k be great for oldery & handycapped A human assistant cost 100k a year
A dog assistant cost a can dog food and a packet of sparky dog Biscuits but last 10 years . a cat will stare at you from afar until hungry xd
Boston Dynamics was founded in 1992, so make that 3 decades…
en.wikipedia.org/wiki/Boston_Dynamics