MOBILE ALOHA Google's new OPEN SOURCE robot
ฝัง
- เผยแพร่เมื่อ 5 ม.ค. 2024
- Check out my new channel (please):
Stanford's New Robot BREAKTHROUGH is a Game Changer
• Stanford's New Robot B...
OpenAI GPT Store | Google Deepmind's Robots and Google Bards Goes Ultra (for a price):
• OpenAI GPT Store | Goo...
My AI Playlist:
• AI Unleashed - The Com...
![Google Just Put an A.I. Brain in a Robot [Research Breakthrough]](/img/n.gif)
Check out my new channel:
Stanford's New Robot BREAKTHROUGH is a Game Changer
th-cam.com/video/w6LhQGJhYFM/w-d-xo.html
OpenAI GPT Store | Google Deepmind's Robots and Google Bards Goes Ultra (for a price):
th-cam.com/video/9PMfvLknOro/w-d-xo.html
Why is Google in the title of this video, and Stanford in the one on the new channel? I don't think you said Google once in this video. A couple other channels put Google in the title of their videos covering this too... Still haven't seen any evidence of a connection. Maybe I'm missing something, but... Clickbait vibes
If it goes Rogue and you just walk upstairs it's going to wait until the perfect time to go Rogue when it can get its hands on a gun then it will just track your movements up through the house and figure out your position and shoot through the roof... your whole house is nothing but a smart grid your meter for electricity is a smart meter every speaker doubles as a microphone therefore to track your movement and figure out your exact location in the room.
You are one of the best video reporters on AI, IMO. You do not deceive knowingly, you do not add noise, do not cut a lot, you talk understandably, it is easy to listen to you, ....
I did not understand why the new channel. You are a better speaker than the woman in the video on your alternative channel.
Very well said! Whenever I see something new on the front of AI I come back to your channel to get more insights!
This is really amazing! In the cold Sweden of today with snow everywhere it would be nice to use this for getting groceries or remove snow from the driveway 😅
This cool because there are so many advances in training robots in virtual worlds and then translating that to real-world.
So you put this robot in a realistic UE5 environment and let it experiment and fail/learn training and then that training would be generalized to the real world for autonomous tasks. So you really don’t need the human teleoperation, it could learn that all through virtual weights/biases and rewards. Amazing!
That looks like it is ACTUALLY a sub-100 US DOLLARS robot, aside from the computer.
I absolutely would not feel safe with that thing near me. Strong enough to hurt me and dumb enough to have no clue that it is.
It's like seeing dial up internet connection all over again... Now we have near instantaneous internet speeds.
Apply that to AI and robotics.
I love your new channel and I subscribed on it. I just would like to know if the voice in the channel AI or Real Human🤔😂 you can make a quiz for your subscribers. and If you can put the link in the description too.
Imagine soon we will see one or two of these build another one of them (without teleportation) that will be wild
*teleoperation
Wouldn't be surprised if they compete with Tesla Optimus and Figure1 and other companies this way. They would be forced to innovate and reduce prices.@@DrBreadstick
I lost my mom to dementia in 2023 not long after chatGPT came out and the whole time I was helping her I was thinking if this had happened a couple years from now I could have done so much more for her with this type of stuff. I think they need to figure out the smart glasses 👓 to be able to record video and act as a second memory to remind people of things.
Health care quality will explode in the next years. That's why I want all of this to happen as fast as possible. So many people are suffering that wouldn't have to (or not as much) if we had the technology now that we will have in 5 years.
I’m sorry about your mom. I lost mine due to a different issue but my dad is in a home with dementia. I was diagnosed with dyslexia as a child, but now I have realized that I’m autistic and have ADHD. I’m 45 now and my cognitive function and short term memory is declining. I’ve been using ChatGPT ever since it first came out, but I quickly realized how absurdly powerful this new language model was. I see a wonderful future and the barriers will come down for people who have disabilities or undesirable, undiagnosed traits. Even if the models don’t improve at all, we will still get there very fast. I hope I can make my Dad proud someday.
I lost my grandma to dementia 8 years before I lost her to death
All this time I was thinking about AI that passes the dementia person's Turing Test
It's possible to build an avatar of a family member and a person with dementia will not be able to tell it's not real, so they can talk to the loved ones all day long
Could be life changing
YOUR FATHER IS ALREADY MORE PROUD OF YOU THAN I CAN EXPRESS WITH WORDS BROTHER. I CAN GUARANTEE YOU THAT. Your humble, optimistic, self-aware and generally noble attitude is one that would make any parent incredibly proud. Try not to let the thoughts and opinions of others sow seeds of dissent in your mind my friend, YOU ARE BETTER THAN THAT. Happy F*cking New Year, Be Happy, Be Lucky but most of all bro, Be You. @@ColinTimmins
@@AlexanderGambaryan Maybe in some cases but my mom would have known that no matter how good that tech was at least for the next decade. For her and the people around her it was more a loss of memory and confusion of executive function but they knew what was real but I bet a lot of elderly would still enjoy something like that even knowing it was AI haha. A lot are very lonely. Even I like talking to ChatGPT on my phone now. I keep it on a female voice more some reason.
Thanks a lot for your very nuanced perspective without beating the hype drum!
As they said is @TwoMinutePapers right? Shoutout!!! Great AI trends breakdowns man.
I assume some enterprising people are going to network robots together and share data files. Then it's you training how to clean your bathroom, them training how to clean theirs, and the network getting more specific and also general knowledge about how to clean A bathroom.
It is a very nice demonstration of current technology. It is not a breakthrough, but an inspiration of what is possible today.
Twenty to fifty examples per activity is not much to learn how to do something and to know if it was successful. It doesn't have to be perfect, but the skills learned can be improved with further experience. My daughter also needed about that many examples to be able to do Omlet. In the beginning, things still went wrong from time to time. After a while, she was way ahead of me. Today she beats me in almost everything except maths. But that's still to come.
It's absolutely fascinating how the industry has developed over the past twelve years.
But we shouldn't expect technology to bring about a social breakthrough. Even today, everyone in the world could live in prosperity by working three days a week and six hours a day. It is up to us as human beings to achieve this, and technology can only help.
blimey imo this year is going to an amazing explosion of robot and AI tec thanks for sharing and this defo shows this is going to accessible to many as well. Now just to sort out the energy demand for each household thats also going to elevate many times !!!
"In case it goes rogue, I'll just walk upstairs" 😂Love it!!
Yeah until it sets the house on fire and says come back down.., I'm wai-i-i-t-ing!!! 😱
Imagine a factory floor with 100 of these things and one human training them all at the same time. After they are trained that same human can supervise them and if one unit encounters a problem either fix the problem (if the robot can't) or add more training on how to handle the problem (which is then shared to all 100 units).
What human?
Very exciting video. I could not help sending it to a bunch of people.
Love your vids Wes. Thank you!
Welding and cleaning the welds!
“I’ll just walk upstairs” lol
It would be interesting if someone could design a replacement for the robot arms, since they are what is most expensive. Perhaps some DIY 3D print project.
Hmm, it looks like food coloring in water… so, did they turn water into wine?
Make a forklift with this same training technique
I was just watching your video from 13 days ago saying it was unlikely we would see a household robot in 2024. Literally just days later we get this announcement 😅. That's such an epitomization of the progress of AI. Obviously there's lots of caveats, but it was just kind of funny 😊
Good video !
Wes, we love Two Minute Papers as well :)
People are gonna get so rich by putting these robots to work.
Wes, your shows are vey informative. Screw the haters, if they don’t understand how the TH-cam algorithm works, they should not be commenting. Let them go find boring titles with boring content , so long haters
It needs to have an up ir down function to get something off the floor.
Such a smart learning system, who needs the expense of training and compute to do all this from scratch. It's like a RLHF variation. 🙏
Cool stuff, particularly impressive that they could make it work with such a relatively small budget.
I think the most limiting issues are that it seems to need a very consistent environment, that is I doubt it has any capacity to deal with surprising events like you'd expect a human to do in any job.
What about privacy, are the video feeds recorded and stored somewhere? Then it is illegal to use in public in some countries. I know Tesla is doing it with some of their cars, and lots of people are just now realising they are being recorded in public without prior notification or consent. The cars are supposed to blink and show on the screen that it is recording, but it doesn't seem to do that quite often, so maybe we will see a bunch of legal cases around this and get some clarification about what we can and cannot do with things that can record their environment autonomously. Until that is figured out I'd be reluctant to put this in a public place.
Still, it is a great product for people to start experimenting and learning how to adjust to these new possibilities at lower and lower costs.
I wonder if it's transferable. Say you had a line following robot. Could you hook up just one camera and two motors for the wheels and get it to work.
Yeah with this one, it’s really cool to see we have the mechanics down enough to actually put the meal together, but for the time being I feel as this would be nothing more than a than a tool to aid people in fast food chains…… for now
Based on Google's track record, they'll can this project within 2 years.
The fisrt command i would teach it to do is plugin itself to the wall to recharge.
"Go recharge"
Oooooooh the grippppper baby
I will know I’m living in the future when a robot can plug itself into a power source
You are living in the future. See Roomba, robot lawnmowers, warehouse robots, postal robots, etc😄
Edit: actually, this robot can plug itself in, lmao.
Look if you teach it to cook, you better believe training it to stab someone, is only one step away.
I think right now they are in the stage of teaching it NOT to (accidentally) stab someone.
Most important is to teach the robot to be gentle and not smash the wine glass !
Where is the skills(training data) repository?
😂"walk upstairs"
Scutter-bots from Red Dwarf!
I don't like saying this, but before using the robot in the home, you might need to know if any damage it caused would be covered by insurance. Maybe it's fine until insurance companies start putting in exclusions for damage caused by robots, but I don't know.
Loved the video... but regarding the safety of this "robot", what about all of us who live in flats, DID You not consider us at all?? ;) We don't even have a cellar to hide in!!
Best regards
It's quite interesting to observe that there's a lack of urgency in regulating robots capable of causing physical harm to humans, yet there's a significant push for regulations on Large Language Models, which essentially operate in the realm of mathematics and language processing.
Absolutely love this..
I hope LLMs and Robotics is open source and free for common folk to use.
I hope it doesnt all concentrate in few hands because unlike industrial and tech revolutions, this one much bigger implications. Outcomes from these advancements are going to decide very few winners and rest of the world jobless.
Mobile Aloha + Eureka (from Nvidia)
Will be remembered in history. Get ready when they integrate with Voyager 🤯
Also did you know that Eureka & Voyager (Minecraft) are from the same team? It's gonna get nuts
Could you elaborate?
@@aravindkm2012 check them papers out. Eureka gives fine motion control & dexterity without humans needing to write the reward function. Voyager was a Minecraft AI (by the same team) that explored the world and they showed having an expansive skill-lib that continuesly learns new things, which made it actually a good player in the game.
Imagine combining all of those. At least physically, we might get very competent dynamic machines much quicker than anyone thought
Download new cooking LORA --
😵 "I know ratatouille!"
I did a stint at kitchen cabinet layout on the 2020 system at Lowes back in the mid-ought period. The progressive manufacturers had a line of accessibility features and sizes. The first one to standardize this robot function to a layout and have it completely working out-of-the-box is going to have the breakthrough of the decade. I wish I had one of these just to crack the egg.
🎯 Key Takeaways for quick navigation:
00:00 🤖 *Introduction to Mobile Aloha, a new robotic system*
- Overview of Mobile Aloha and its capabilities,
- Mobile Aloha's affordability and customization options,
- Safety and potential household applications.
02:02 🍳 *Mobile Aloha's Teleoperation and Learning*
- Teleoperation and learning mechanisms in Mobile Aloha,
- The distinction between autonomous and teleoperated actions,
- Use cases in cooking and other manual tasks.
04:22 📚 *Imitation Learning and Data Collection*
- The role of imitation learning in Mobile Aloha,
- The process of data collection through human demonstrations,
- The importance of repetition in teaching tasks to the robot.
06:12 🧠 *Autonomous Capabilities and Generalization*
- The robot's autonomous capabilities and generalization of tasks,
- The practical implications of teaching repetitive tasks,
- Examples of tasks that can be automated.
08:22 🏠 *Household Applications and Safety Considerations*
- Potential household tasks for Mobile Aloha,
- The safety aspects and concerns of operating the robot,
- The cost-effectiveness and accessibility of the technology.
10:02 🌍 *Broader Implications of Robotics and Automation*
- The impact of robotics on labor and productivity,
- The future of autonomous robots and their capabilities,
- The potential for unlimited labor and its economic implications.
12:06 🛠️ *Technical Setup and Community Access*
- The technical aspects of setting up Mobile Aloha,
- Accessibility of the technology to the public,
- Community involvement and potential for innovation.
13:18 📢 *New Channel Announcement and Mission*
- Announcement of a new AI news channel,
- The mission to provide clear and unbiased AI information,
- Encouragement for community support and engagement.
Made with HARPA AI
docs.google.com/document/d/1_3yhWjodSNNYlpxkRCPIlvIAaQ76Nqk2wsqhnEVM6Dc/edit has the 3D models
OK, but when do I get the clothes folding bot?
imagine being stab 50 times and then you coming back from hospital and see robot with knife xd
Oh gosh, don't tell me you're really starting with those "SHOCKS THE ENTIRE INDUSTRY" titles. I get it, gets more click, but it's really painful to me.
Unfortunately, you have to engage in CLICKBAIT, to compete with all the CLICKBAIT on YT.
So it doesn't shock the industry?
It did shock me. Seems like a decent level up. Loved how it also is made to be controlled by humans and learning from that.
I'm going to take this as intentional parody for now
Oh yeah. Wes has been changing gears for a couple months now. He's into the exploit/pandering phase after seeing some nice growth to his channel. It's a shame to see. Thought he was better than this. He may have just got lucky during the Ai news hype boom and was in a position to explain some of it nicely but now that the hype has leveled off a bit he's trying to appease the algorithm by pumping out content at a regular pace and it has him scrambling.. bandwagoning.. overhyping and generally running out of ideas
Honestly this is moving too slow they need to hurry up and achieve AGI
We've been working on autonomous driving for decades.
I like all the faith that people have in human innovation, but this is a very, very hard problem.
We might have something that people call AGI within a couple years, but I'm saying 50 years before true AI.
Where's the link to the new channel? Natural 20?
Teach them karate.
Have fun with the salmonella absolutely everywhere in your house after that robot grabs raw chicken, never washing its “hands” and then touching everything else in your house! Any basic human being knows this…
Have you ever seen the Matt Damon movie "Elysium"? If not, watch it. That's where we are heading, only without the Matt Damon character to save us.
"Macro" would've been a way better name.
would be better if it could use pose estimation from the skeleton of a human to learn from seeing what humans do
Never fold laundry again? 32k? I should be alive for 40 more years. So $800 a year. $2 a day. Hmmm. I dunno folks...its starting to look reasonable.
Would make a great security guard, pet sitter, probably baby sitter (non infant),etc. I'd not trust it so much for breakable tasks. Eventually, but no way I'd trust it unattended in a kitchen with running water and open flame right now. Very impressive, and a glimpse into the obvious near future.
Is food making a breakable task? With some supervision, similar to autonomous driving, we could have automated food production
I would make it do production work, to pay for a human household cleaner, since the cost savings for limited household chores per time period can be less than unlimited production output income.
TAKE MY MONEY
Still human operated
What are we going to do? I'm so lost
This is more than a macro - it's the beginning of LMMs - large motoric models...
Remember back in America when it used to be legal and socially acceptable to own an "Aunt Jemima" like slave? I'm going to be super nice to mine, just in case.
Expect the $32,000 price tag to drop very rapidly for a basic model as companies begin to mass-produce these things. Also expect to see industrial models with much higher price tags.
Expect the "base" model to be able to do most everything, so long as you have the appropriate active subscription 😄
Why can't they teach the robot to do these different basic stuff that most homes would need and want and then have these trained models of the different tasks be already integrated into its AI mind? so it would come out of the box ready to do different stuff and if the user would want the robot to learn a new thing to do then the user would still have the abillity to do so.
Wes, forgive me but I cannot see the link to your new channel above?
I have found it though: @ NATURAL-20
Unbelievable, the best thing that could happen to ADHD affected people like me
Let's be a bit more realistic and pragmatic.
We are getting way ahead of where the current state of the art is. What happens if the faucet in the restroom is leaking? What happens if the burner in the kitchen doesn't ignite or ignites improperly or the flame has a different colour?
We have first to be able to verify what precisely these systems are learning. We can ascertain what a human has learnt by asking questions regarding problems they have never encountered, understand their approach to problem and what the proposed solutions are. We can evaluate their logical reasoning to understand what they have learnt.
It's disappointing that we are getting nowhere even after 30 years of waiting for some, breakthrough. 😢
"Home made robot powered by AI spreads salmonella all around the kitchen and adjacent office space." 😆😆😆
edit: "And then forcefully high-fives everyone against their will."
I don’t mind clickbait titles as long as the video provides value. 👍
What title are you seeing? Mine isn't click bait.
But yeah, I agree.
I've heard of Robot Chicken but never expected this as a kid staying up til 3am. Just incredible to see how far we've come within a whole year.
I would 100% let this thing do stuff for me (if I didn't have to pay for it, because that's way over budget for me). Even if it did just one thing very well it would be such a relief never having to do that thing again.
Man, rough day to be an "I am not a robot" button!..
Not ready for prime time. That's what I'd say, and send it back.
That's probably why you can't buy one yet🤷
I disagree that "it's in between", it get trained and then perfoms tasks like any other AIs
Yes I like this content. You are different..than Al the blah blah so called ai informing videos. Thanks for that
Imagine a robot wife
Why do you want a machine that imitates other people's wives???? That's a losing proposition from the get-go. You really want the worst of all worlds in your home? ;-)
Why is it called a "google" robot in the title? AFAIK it is not linked with Google?
Robot components: 3000
Teleoperation system 33000
When is it likely that we would have such versatile robot with arms (by Google or other company) being sold as a ready product? - are we talking about in a few years maximum or more like in a decade?
(Im reffering to a user friendly robot that doesn't require any knowlege about AI and such, so it would come all built up and ready to be used in an average home environment)
I'd get it on an alarm to make my oatmeal and tea every morning and, maybe lay out my work clothes. Very simple and repetitive stuff that takes time. I could sleep in till 430 or 435am instead of 415. Those 15 minutes add up. Maybe, more advanced models could do the cleaning. I don't feel this one is discerning enough yet. I worry about it chucking something valuable or putting my wool jacket in the washer. Stuff like that. It'll get there soon
At this price, I would not be surprised to see them doing overnight retail stocking and order picking within this year, maybe 2025.
How will the average person afford to put one of these in their house when they don't have a job or even have a house to live in because they've been replaced by robots? Terminator won't need a gun to kill you. He will just take your job and you will starve to death.
I've been telling the "build a wall" types that they'll be looking back at "illegals taking their jobs" as the good old days for years now😂😢
@@tracy419 Have you ever seen the Matt Damon movie "Elysium"? If not, watch it. That's where we are heading, only without the Matt Damon character to save us.
I would first teach it my madden and cod skills 😂
yes absolutely yes. I'm not gonna get married and lose my half-shit in divorce. I'm gonna buy that robot right away
If you think that the reason to get married is so you don't have to do any chores, that's probably for the best😂
How many hours of build time? I'm thinking of paying someone to build it as that would be my bottleneck
I imagine that soon it won't be more than 1000 dollars when mass-produced
Teleoperation = Remote Control lol
Pretty cool that things looks like a good cook or im really hungry lol think little of both
rly hope this will end modern day slavery in produce farms in the US
I'm so excited for the possibilities this opens up! We'll all get so much more done, and don't forget the potential benefits for the disabled and elderly.
I'm thinking of building it - anyone else?
how much of this video's production is similar to their fake AI video?
Since there's also a bloopers reel for the robot malfunctioning, I'd say there's a very good chance this is not fake.
Damn this is gonna replace all women
So for every action they need to be trained beforehand and if they get into a new situation they would have no idea what to do. Not impressive.