Google's New BREAKTHROUGH Robot Changes EVERYTHING (Mobile Aloha)

แชร์
ฝัง
  • เผยแพร่เมื่อ 5 ต.ค. 2024
  • The Mobile Aloha robot is here! Demos of the robot have been spreading on the internet like wildfire. This inexpensive robot is more capable than anything else we've seen. Let's take a look.
    Enjoy :)
    ModelsLab - An API so you can focus on building next-generation AI products and not maintaining GPUs. modelslab.com/
    Join My Newsletter for Regular AI Updates 👇🏼
    www.matthewber...
    Need AI Consulting? ✅
    forwardfuture.ai/
    Rent a GPU (MassedCompute) 🚀
    bit.ly/matthew...
    USE CODE "MatthewBerman" for 50% discount
    My Links 🔗
    👉🏻 Subscribe: / @matthew_berman
    👉🏻 Twitter: / matthewberman
    👉🏻 Discord: / discord
    👉🏻 Patreon: / matthewberman
    Media/Sponsorship Inquiries 📈
    bit.ly/44TC45V
    Links:
    Mobile Aloha Homepage - mobile-aloha.g...
    Robot Software - github.com/Mar...
    Part List - docs.google.co...
    Research Paper - mobile-aloha.g...

ความคิดเห็น • 418

  • @matthew_berman
    @matthew_berman  9 หลายเดือนก่อน +86

    Seriously...do you want one of these in your house??

    • @PoppSoundProductions
      @PoppSoundProductions 9 หลายเดือนก่อน

      It this version. No. But give them 3 years and this bitch will look like Walle and you will want one yourself.

    • @stevereal-
      @stevereal- 9 หลายเดือนก่อน +8

      The 5th generation one maybe but I love it!!!! This is amazing!!

    • @skylerlegrande56
      @skylerlegrande56 9 หลายเดือนก่อน +7

      Absolutely

    • @thx1136
      @thx1136 9 หลายเดือนก่อน +17

      After I wrap it in a RealDoll® skin...

    • @matthewdignam7381
      @matthewdignam7381 9 หลายเดือนก่อน +2

      If they could implement an AI on the scale of gpt-5 into this thing, then I would in a heartbeat, although just thinking about it, this could do a lot more then choirs, this could do a LOT of manual labour jobs with enough training and data, for people who don't need to spend 100k on a Tesla bot, then could spend 30k on this depending on their needs, i feel like it could even take my job as a barista by the end of the year

  • @RightOverWrong
    @RightOverWrong 9 หลายเดือนก่อน +112

    Just watched that video. That project is wild. Open source and 30k in COTS parts all by a part time team of 3 phd students.
    Made me think of something wild. It has two modes of operation. First a fully autonomous ai mode. Secondly, a human operable mode where you train it with your movements that can then be usable in mode 1. Because the robot is open source you can have people around the world build it and as they train it in different tasks you upload that data to be downloadable by the rest of the community. The rate of improvement would be insane, literally overnight.

    • @phen-themoogle7651
      @phen-themoogle7651 9 หลายเดือนก่อน +5

      Yes, that's a brilliant way to train them via a community across the world.
      Just gotta make sure some of the tasks aren't something messed up like picking locks(robbing banks)/attacking pets or people or illegal things etc
      We can see all the good applications and how helpful they can be, but how many criminals will use this technology too, at least robots are ultra slow right now and that was speed up at 6x speed for most of the tasks. But it's pretty wild that you can train them to do almost any task if they just need to have muscle memory.
      It's scary, but also cool because robot sports might be interesting to watch in the future. Robots boxing/swimming etc

    • @TimScott-x2d
      @TimScott-x2d 9 หลายเดือนก่อน

      hopefully they build the site to do this, someone will clearly

    • @kevinnugent6530
      @kevinnugent6530 9 หลายเดือนก่อน

      A wireless, "growth spurt", every night while it is idle.

    • @andrewferguson6901
      @andrewferguson6901 9 หลายเดือนก่อน

      ​​@@phen-themoogle7651autonomous security deposit box lockpicker and burgaler

    • @sssurreal
      @sssurreal 9 หลายเดือนก่อน

      @@kevinnugent6530Jesus it’s over 😂

  • @toastrecon
    @toastrecon 9 หลายเดือนก่อน +47

    What would really make this go crazy: virtual training. Use a game engine to model physics and what the AI would see. Train it on 100 years of household tasks in a few days, and then clone the AI to as many butler or chef robots as you can

    • @kevinnugent6530
      @kevinnugent6530 9 หลายเดือนก่อน +7

      I think the fact that there's possible to connect all of them wirelessly and if there are a million of them out there, then they will learn quickly anyway.

    • @HistoryIsAbsurd
      @HistoryIsAbsurd 9 หลายเดือนก่อน

      Nice

    • @VperVendetta1992
      @VperVendetta1992 9 หลายเดือนก่อน

      Nvidia is doing that

    • @HenkLeerssen
      @HenkLeerssen 9 หลายเดือนก่อน

      Did my headhunter at Tesla already called you? If not.. keep your phone nearby!

    • @tjroberts9240
      @tjroberts9240 9 หลายเดือนก่อน

      now we just need Gordon Ramsay to make a training video game.. or someone to take all his videos of him cooking and make them POV.

  • @MistaRopa-
    @MistaRopa- 9 หลายเดือนก่อน +7

    So...we didn't learn anything from the whole Google Gemini stunt I see.

  • @rgspacelictics
    @rgspacelictics 9 หลายเดือนก่อน +16

    Please make one as it's open source

  • @marcfruchtman9473
    @marcfruchtman9473 9 หลายเดือนก่อน +12

    Exceptionally well done... those PhD students just accelerated progress by a huge amount of time.
    This is next level!

  • @drewsarkisian9375
    @drewsarkisian9375 9 หลายเดือนก่อน +8

    Hmmm...considering the previous Google AI "demo"....

  • @vipinsanthosh2230
    @vipinsanthosh2230 9 หลายเดือนก่อน +7

    Also Chinese sweat shops can now be replaced, finally!

    • @HUEHUEUHEPony
      @HUEHUEUHEPony 9 หลายเดือนก่อน

      By chinese people remotely controlling the robot?

  • @Chris-se3nc
    @Chris-se3nc 9 หลายเดือนก่อน +7

    So many pieces to a full humanoid robot are coming together. This, plus the Ameca robot for facial expressions. All of the LLM stuff for conversations. The fluidity of Tesla robot mechanics and Boston dynamics.

  • @jeanchindeko5477
    @jeanchindeko5477 9 หลายเดือนก่อน +3

    And we are just in the first week of the year!

  • @andrewmalcolm79
    @andrewmalcolm79 9 หลายเดือนก่อน +18

    I'm a construction guy and used to joke with my colleagues about maybe if we had enough bit extenders we could be working from home like our management. Tah-Dah! This thing's a God send!

    • @EntangleIT
      @EntangleIT 9 หลายเดือนก่อน +1

      Co-training, like you operating a drill remotely, using one of these, is absolutely going to be a big career for at least a window of time (maybe forever) while we train AIs to perform all these tasks.

    • @EntangleIT
      @EntangleIT 9 หลายเดือนก่อน

      At least part of our careers anyways.

    • @mr-biz
      @mr-biz 9 หลายเดือนก่อน +1

      The only thing that these robots will be unable to replace is builder's crack when they take your construction jobs.

    • @MDNQ-ud1ty
      @MDNQ-ud1ty 9 หลายเดือนก่อน

      @@mr-biz Good news is that the billionaires won't need the pesky roaches any more. Bezos dream of turning Earth in to a park is coming to full realization! All Hail Bezos! God, master of all! Daddy!

    • @bigglyguy8429
      @bigglyguy8429 9 หลายเดือนก่อน

      @@mr-biz You under-estimate the technology....

  • @andrewandreas5795
    @andrewandreas5795 9 หลายเดือนก่อน +3

    Most of these videos show the robot being teleoperated and not acting autonomously

  • @grizzlybeer6356
    @grizzlybeer6356 9 หลายเดือนก่อน +9

    This video brings back memories of the Chernobyl incident back in the 1980's where it would have been nice to deploy robots trained on disaster tasks so humans would not have to be deployed in such dangerous conditions. I do believe with some modifications these are capable of handling such dangerous tasks. Kudos for the video

    • @ChromaticTroubadour
      @ChromaticTroubadour 9 หลายเดือนก่อน +2

      I believe the robots they tried to use first broke down quickly from the extreme radiation, so they had to resort to human "liquidators" wearing extremely heavy (but still inadequate) lead armour...

    • @bartek4210
      @bartek4210 9 หลายเดือนก่อน +1

      In Fukushima, Japan, the problem was not lack of robots but that they were breaking very quickly due to high radiation

  • @MeinDeutschkurs
    @MeinDeutschkurs 9 หลายเดือนก่อน +3

    The machine that will kill us at failure.

  • @5thfundamentalforce
    @5thfundamentalforce 9 หลายเดือนก่อน +11

    This is incredible! I'd love to have one of them

  • @FreudsHIPS
    @FreudsHIPS 9 หลายเดือนก่อน +5

    So it's a bit like using an AI to grade an AI, only the grading is done by humans and then the AI generalises from there. It's RLHF with the HF first. It's exciting because the AI learns to generalise after the human hands over the reins.

    • @wege8409
      @wege8409 9 หลายเดือนก่อน +1

      Great observation

  • @Resursator
    @Resursator 9 หลายเดือนก่อน +1

    5:20 My brain had some tricky perception visual glitch.

  • @anianait
    @anianait 9 หลายเดือนก่อน +1

    I think most of those videos of complex tasks are those guided during training

  • @sitedev
    @sitedev 9 หลายเดือนก่อน +1

    It looks like a 3D printer then went rogue and printed itself into a robot.

  • @sugaith
    @sugaith 9 หลายเดือนก่อน +1

    This is the most important channel in YT right now

  • @ypaez03
    @ypaez03 9 หลายเดือนก่อน +2

    Compleatly agree this is mind blowing. I believe this project can spur the creation of new real-life practical robots everywhere.

  • @arbeitslos4247
    @arbeitslos4247 9 หลายเดือนก่อน +1

    Cyberdyne Systems T-0001 has this tech already working for general use. Can’t wait for the next models they may release in the near future!

  • @royromano9792
    @royromano9792 9 หลายเดือนก่อน +2

    It looks like the legs could just be an RC car or a Roomba vacuum. Don't have to buy anything special for that, it'll save you 7k just by doing that. Now 1k for the battery? You could definitely just use something that will last you for 2 hours or so, so $500 would be more than enough. Now as far as the robot arms, I do not have any ideas... But there you go, I saved you $7500!

  • @TheMajesticSeaPancake
    @TheMajesticSeaPancake 9 หลายเดือนก่อน +4

    Soon these will cost 10,000, be less bulky, perform a wider variety of tasks, and be more consistent in successful task operation. At which point it's a no-brainer to buy, the time saved from household chores will be huge. It may be a while before it's a top tier chef, but once it can make many different decent quality meals, from store bought ingredients, that'll be huge as well.

    • @lauridskristensen9800
      @lauridskristensen9800 9 หลายเดือนก่อน +1

      Will this (one of your) robot assistant(s) then get to enjoy a solo trip to the store to get the ingredients it needs, do you think? Or is that a different assistant? Or does the store send their delivery robot to hand over the groceries to (one of) your assistant(s) at your door instead? Or will we rather be assisted by a fleet/swarm of rented robots, waiting to serve us on every street corner (and lake bottom) like those pay-as-you-go electric scooters?!

    • @TheMajesticSeaPancake
      @TheMajesticSeaPancake 9 หลายเดือนก่อน +1

      Well ultimately yes, any and all of those things. At the time of the robot I described above i'd still prefer going to the store, I like being able to improvise. But as things get better, yes I wouldn't mind the robot managing a list of what i usually like to have, and ordering appropriate restocks of what I like and have regularly. At which point I'd only go to a store when i want to explore options to expand my palate. On top of all this, given the extra free time i'd have in my life i'd like to manage my own garden, which would supplement the amount of food I need to get from ordering. Which i'm sure a robot capable of doing all sorts of household chores could help with as well. But things in stages, some of the capabilities you described I see as being more ahead of what described, at least when it starts being available. The way I see it is there's several development steps before get to automatic store to table at home meals/equivalent chore capabilities. Such as more compact robotics, better manipulating parts, more consistent task performance, strong safety rating of not injuring humans in the working area, task priority and ordering (thinking of getting the ingredients *ahead* of dinner sort of thing), and a few other similar hurdles. Plus price, a lot of those things are kinda possible now, but very expensive and still not to the level of quality we'd really want. My guess is a 10,000$ bot that can do full food ordering/cooking, dishes, laundry, cleaning, and other similar level tasks is more gonna be 2026, though possibly mid 2025. I think there will be stuff with about half the quality and twice the price (25000$ with much higher task quality/consistency, and wider task range) than that shown in the video, by the end of the year, and as a commercial product coming to market. So probably not released, but certainly demo'd advertised, and on it's way publicly. @@lauridskristensen9800

    • @bigglyguy8429
      @bigglyguy8429 9 หลายเดือนก่อน

      @@TheMajesticSeaPancake Can you imagine a bunch of fat slugs, spreading over their sofas staring into their 3D goggles or whatever, while all manual work is done by a sexy-looking robot or two? I've worked at home for year and never found housework much of a burden. Gardening on the other hand...

    • @TheMajesticSeaPancake
      @TheMajesticSeaPancake 9 หลายเดือนก่อน +1

      Well if you don't like gardening you can do all the dishes while a robot tends to your front lawn while I do the opposite. As far as what other people do on their couches, well good for them, not my problem.@@bigglyguy8429

  • @stevereal-
    @stevereal- 9 หลายเดือนก่อน +2

    manufacturing and my dishes are extremely excited!
    Great research video Matthew

  • @RichardGetzPhotography
    @RichardGetzPhotography 9 หลายเดือนก่อน

    9:11 that logic is NICE!! flipped the lid so it would fit better!

  • @TimScott-x2d
    @TimScott-x2d 9 หลายเดือนก่อน +1

    I think all time lines are gonna move up every year, 5 years before these are almost everywhere

  • @liamhill1702
    @liamhill1702 7 หลายเดือนก่อน

    0:52 it even shakes the fuckin pillow in 😂😂😂 Idk why that was so funny 💀

  • @Chris-se3nc
    @Chris-se3nc 9 หลายเดือนก่อน +1

    I think it’s ready to go out into the field with some soldiers and learn from them. Skynet is close.

  • @alinayossimouse
    @alinayossimouse 9 หลายเดือนก่อน +2

    I can't wait for the $32k machine to cook me a piece of shrimp with a success rate of 40% after I've demonstrated it to it 20 times. Exciting yes, "likely to be my assistant in the very near future" probably not.

    • @lidholt
      @lidholt 9 หลายเดือนก่อน +2

      Yeah, a bit of skepticism would be nice in these hype videos. 😂

    • @sssurreal
      @sssurreal 9 หลายเดือนก่อน

      5-10 years is the near future

    • @alinayossimouse
      @alinayossimouse 9 หลายเดือนก่อน

      The idiom "in the very near future" means "in 5-10 years" to you? ChatGPT tells me
      > "In the very near future" is subjective and can vary, but it generally implies a short and imminent timeframe, typically within the next few days or weeks.
      @@sssurreal

  • @observingsystem
    @observingsystem 9 หลายเดือนก่อน

    I can totally see myself doing the dishes with my robot, hi-fiving each other haha.

  • @notnotandrew
    @notnotandrew 9 หลายเดือนก่อน +2

    I just want it to be verbally trainable via LLM integration. I want to be able to tell it “After flipping the shrimp, you should move it to the center of the pan so it cooks more quickly and evenly,” and I want it to remember that advice permanently.
    I’ll be truly impressed once it can handle zero-shot, verbally instructed tasks like “flip each shrimp using the tongs” when the tongs are hidden in some drawer somewhere. It would need to reason: “I need a set of tongs, but I see none. Where might I find one? One is likely to be in one of these drawers. I’ll search each one, but I’ll have to be quick or else the shrimp may burn. [...] I’ve found the tongs and can now continue the task.”
    Until it can do that successfully (and is guaranteed not to break anything or burn down my house), I’m not shelling out $32k.

    • @Greekstory58
      @Greekstory58 9 หลายเดือนก่อน

      Too bad we can't download their trained AI model. You have to train by yourself! 😢

  • @marcb934
    @marcb934 7 หลายเดือนก่อน

    I just realized that Apple Vision Pro could be used as a tool for training tasks for robots. It already tracks your hands, eyes and the surrounding space. This can be huge.

  • @OproDarius
    @OproDarius 9 หลายเดือนก่อน

    I want to state the depth that you put into the technical aspects of the paper into this YT video. Already watched to other AI YT creators and they just touched the subject in the technicalities that you went into!
    Keep it this way!

  • @SzaboB33
    @SzaboB33 9 หลายเดือนก่อน +1

    Not gonna lie, I giggled when you said $32k after you said it was affordable. :D It pulled me back to reality. :(

  • @JosephCardwell
    @JosephCardwell 9 หลายเดือนก่อน +1

    This is it buddy. The cost will come down radically over the next year and they'll be everywhere. The robots are here.

  • @ymroddi
    @ymroddi 9 หลายเดือนก่อน +13

    HUGE impact for elder care.
    A lot of nations are facing a looming crisis of elder care for the huge boomer generation.
    This would be a massive burden (financially and emotionally) on the younger generations.
    Robots that can handle a lot of these burdens will have a huge societal impact and save lots of money (and the kid's sanity)
    I should be building and customizing this robot tomorrow and fundraising on Monday.

    • @Juttutin
      @Juttutin 9 หลายเดือนก่อน

      Although this will also be a tragedy. Aged care workers often earn minimum wage, and their tasks will be "easily automated", but the human contact that decent care workers provide for many elderly is invaluable.

    • @ymroddi
      @ymroddi 9 หลายเดือนก่อน

      @@Juttutin Not a tragedy at all. A huge of amount of people will not be able to afford care workers year after year.
      It's these robots or the family has do all this stuff themselves.
      It will be a huge help for people all across the world.

    • @Juttutin
      @Juttutin 9 หลายเดือนก่อน

      @@ymroddi it probably depends a lot on where you are. I've had exposure to the budget end of for-profit elderly care, and some of those (already quite dystopian) places would cheerfully replace most of the workers with robots if it was cheaper.
      Also my Mum, who is very independent and living alone, would probably prefer, at some level, a mechanical rather than human cleaner (as would I perhaps, our family seems to be genetically loners).
      But it's not healthy. Human contact leads to statistically meaningful improvements in average health, life quality, and lifespan.
      Both can be true.

    • @ymroddi
      @ymroddi 9 หลายเดือนก่อน

      @@Juttutin So you are proposing family stay with the elderly to provide 24/7 support for years (decades?) - or simply have robots take away a good deal of this burden. One can have robots and human contact. It really isn't one or the other. There will no doubt be a huge need in coming decades that the care industry will never be able to satisfy with available staff - even assuming people could afford it. And they can't afford it. I many many cases it will simply be robots or no care at all.

    • @Juttutin
      @Juttutin 9 หลายเดือนก่อน

      @@ymroddi there are already many places where the human contact in elderly care is severely limited and understaffed, despite high unemployment. I am not making any proposals, just cautioning that for many, our economies are such that there will be incentives to replace, rather than augment human staff where possible, regardless of any available but underutilised workforce. Because providing the bare minimum is more profitable.
      I don't see (yet) the structural economic changes that will be required to prevent low-cost elderly care from sliding further towards some black mirror episode.
      On the other hand, I can easily see how, for the reasonably wealthy, a few robots will allow care workers to spend much more time on the intrinsically human aspects of elderly care.

  • @jason_v12345
    @jason_v12345 9 หลายเดือนก่อน +1

    I forget who said it, I think Elon, but the difference between getting a robot to do what you want 90% of the time (or in this case 80%) and getting it to do it 99.999% of the time, which is the only rate acceptable in a consumer product, is night and day.

    • @ich3601
      @ich3601 9 หลายเดือนก่อน

      My success rate is 90 to 97%. But the robot need cams to check success of corse. Plan, do, check, correct. Like I do. Coming next.

  • @almor2445
    @almor2445 9 หลายเดือนก่อน +1

    Yet more sped up speed cut videos of something robotics experts first managed 15 years ago.

  • @overdriver99
    @overdriver99 9 หลายเดือนก่อน

    this is crazy good. 30k AI OPEN source robot can do dish, cook and laundry ??? OMG.... it makes coffee for you

  • @sujitvasanth2502
    @sujitvasanth2502 9 หลายเดือนก่อน +1

    thanks for highlighting the significance of this new innovation - great video!

  • @thesmallestatom
    @thesmallestatom 9 หลายเดือนก่อน +4

    Thank you for the update on this! Definitely 10 years or less. The price makes it ripe for massive optimization. Would like to see it for like $7500, maybe $10k tops?

    • @14supersonic
      @14supersonic 9 หลายเดือนก่อน

      There's definitely a lot of optimization they could do to this rig overall to improve efficiency and cost. For one bipedality could help eliminate the need for the hefty power systems, and among some of the other expensive items that would be swapped out for more anthropomorphic parts. $7000 to $10k could be very achievable for a competent robot companion.

    • @VperVendetta1992
      @VperVendetta1992 9 หลายเดือนก่อน

      I'd say 2 years to reach businesses for 10k and 3 to reach consumers for 5k.

    • @bigglyguy8429
      @bigglyguy8429 9 หลายเดือนก่อน

      @@VperVendetta1992 2nd hand sexbots for 500...

  • @gj1234567899999
    @gj1234567899999 8 หลายเดือนก่อน

    Please god this can’t come soon enough. I spend 2-3 hours a day just on chores cleaning up after kids and laundry etc. there is so much I want to do. having a robot do all this would make me super productive. Also a robot that could garden could cut down on my grocery bill and give me healthy food.

  • @paulbishop7399
    @paulbishop7399 9 หลายเดือนก่อน

    ok, so take the shrimp out of the saucepan, this robot will still continue to "cook it" in the pan, when it is not there anymore ;)

  • @patrickvieira9200
    @patrickvieira9200 9 หลายเดือนก่อน

    I just want to be alive to see Gordon Ramsey yells to a bunch of cooking robots

  • @shotelco
    @shotelco 9 หลายเดือนก่อน +1

    George Jetson's (The Jetsons) maid is a robot named Rosie. Rosie is a Model XB-500, an older, high-tech robot that the Jetson family hires from U-Rent A Maid.
    This "U-Rent" business model allows an economy of scale with respect to the training cost. Working up a business plan for Venture funding now?

  • @alpharesearch2
    @alpharesearch2 9 หลายเดือนก่อน +2

    It looks like the hardware has great potential to go substantially down in price when mass-produced. I would guess something profitable should be possible in the $4500 range, but depending on further R&D and startup costs, the price could go up.

    • @Sci-Que
      @Sci-Que 8 หลายเดือนก่อน

      With a bit of cosmetic appeal and a little bit of tweaking the capabilities, I believe people would easily pay 20K. You certainly could not hire a maid or butler for any extended length of time for 20K.

  • @JeremyRabbit
    @JeremyRabbit 9 หลายเดือนก่อน +1

    Why is Google‘s name on this? This work was performed by researchers at Stanford University. Did Google pay for it or was the Aloha system developed by them?

  • @torarinvik4920
    @torarinvik4920 9 หลายเดือนก่อน

    Most of these tasks were using the tele afaik. It's still cool that it's able to cook a shrimp, though. And soon it will be able to do the dishes and all the other stuff and more just by itself :D. Crazy that it can run on consumer grade hardware. Excellent video as always!

  • @johannhuman532
    @johannhuman532 9 หลายเดือนก่อน

    It is already better than me at cooking certain dishes!

  • @josipX
    @josipX 9 หลายเดือนก่อน +1

    Those are all hardcoded routines though, right?

  • @mainajnabee
    @mainajnabee 9 หลายเดือนก่อน

    That thing better wash its "hands" after cleaning the toilet before cooking my shrimp! 😜

  • @user-on6uf6om7s
    @user-on6uf6om7s 9 หลายเดือนก่อน

    It might still be too expensive for your average working class person but I think if a company was to offer a payment plan for a couple hundred bucks a month for a number of years the way we finance cars, there would be a lot of people willing to have a less fancy car for a while so they can have a permanent cook and maid. Assuming it's effective at cleaning a house it has never seen as it's shown to be and it can cook a variety of meals completely on its own, that alone is worth the sticker price and a financing plan could get the monthly costs down to the price of a meal prep service. Granted, you still have to buy the groceries (or have them delivered via drone and brought in by Aloha) but still, people pay a lot more for less utility.

  • @kingstonchi
    @kingstonchi 8 หลายเดือนก่อน

    My first thought about this was that we need a 3rd hand .. in so many daily chores around the house, in our work, etc., such as hammering a nail while holding up the object in the 3rd hand .. or holding a large heavy carton with two hands while the 3rd opening the door handle .. Then when re-thinking it, I saw that what we really need is to improve the two hands, to provide multi-attachment capabilities, in addition to the grabber ..
    First and the simplest .. so many of the tools we made for our human hands have a long handle, such as a broom, a hammer, a soup ladle, etc. We could engineer a simple straight forward accommodation for this in addition and alongside the 'hand grabber', that would obtain a much better end-result .. Sure, not all the time, but most of the time .. And .. such a small price to pay for a much better result, while staying with two hands .. [which makes the actual human training session easier and more natural] ..

  • @Smytjf11
    @Smytjf11 9 หลายเดือนก่อน

    Did that thing just make a cup of coffee? That's AGI

  • @7kanak
    @7kanak 9 หลายเดือนก่อน

    how many "CHANGES EVERYTHING" would be there , even change would cry

  • @47f0
    @47f0 8 หลายเดือนก่อน

    According to my wife I am incapable of being trained to rinse a dish. Suspiciously, when she saw this video, she asked me how much life insurance I had...

  • @ianhaylock7409
    @ianhaylock7409 9 หลายเดือนก่อน

    "Only $32,000" Man I wish I was American if they think that something that costs so much is not expensive.
    On another note. The robot leaves the frying pan handle over the edge of the cooker, which everyone with kids knows is something you don't do. Also it puts the hot frying pan down on the worktop.

  • @stephenrpell3194
    @stephenrpell3194 9 หลายเดือนก่อน

    Using a mobile desk for the bottom is brilliant.

  • @daniellivingstone7759
    @daniellivingstone7759 9 หลายเดือนก่อน

    So when will I get a robot servant to do all household chores upon my instruction in natural language?

  • @fiery_transition
    @fiery_transition 9 หลายเดือนก่อน +1

    Would love for you to go through technical papers and AI research more, to have something else than doing new model reviews etc.

  • @jackevert4922
    @jackevert4922 9 หลายเดือนก่อน

    Another interesting Video, Thank You. Oh BTW I Like the "Lazy Weekend look"

  • @RonLWilson
    @RonLWilson 9 หลายเดือนก่อน +1

    That is totally cool!
    It would also be really cool if they added two things to the training process where the person doing the training can speak and tell the AI what they are doing where that speech is also recorded and a camera records the video of the training process which could be used to to train the AI to be able to generalize a video of perform that task.
    For example when putting the pot in the cabinet the trainer can say, I am now putting the pot in the cabinet on the bottom shelf using both hands and thus one can train a chat GPT while also training the "muscle memory" where the AI can then link the two together and not only learn to perform a task but also learn how to instruct others in words how to perform it as well as build a textual representation of the robot's library of tasks it knows how to do and maybe even build an ontology model as well.
    BTW, as to how to do the later I have made a number of videos and uploaded them to my TH-cam channel on a way to do that which I call UniML, Universal Modeling Language.
    So in UniML speak, the trainer's words could be treated as Swim Lane Islands (SLI's) which the can be assimilated (gobbled up) into RDF like statements as well as can be used to train a chat bot.
    So then one would have a number representations, the recorded motions, the AI training data derived from them, the recorded speech and video of the training for that task, the importation of that into UniML as SLIs which it then assimilates (which could be done by its own Chat bot that has been trained to do that), and probably more.
    These then could be used to generate training videos and documents as well as be added as part of a world model representation of what is doable as well as how one can do it.

    • @RonLWilson
      @RonLWilson 9 หลายเดือนก่อน

      BTW, co creation of the Ontology model might then be thought of as an artificial consciousness (thoughts) while the AI that can perform the task as muscle memory.
      Thus when the robot is putting the pot on the bottom shelf it can "think" I am no putting the pot on the bottom shelf using both hands because the task was linked to the words via the ontology model.
      It could then take that sentence as use that as a prompt for its own chat bot to see what that might produce like be careful to make sure it is clean before doing that.
      The the ontology model serves not so much as a bot but as the human that ask or tells the bot things, i.e. does the prompt engineering base on its ontology models, that could have been in part created by a chat GPT.
      It is sort of like the left brain conversing with the right brain and vice versa.

    • @RonLWilson
      @RonLWilson 9 หลายเดือนก่อน

      BTW, the another reason to do all this is to facilitate sharing where one person might train their robot to put a pot on the shelf as well as some other person might to the same but with the verbal descriptions added and the ontology model creation they could share these on a network that might then combine the two into a fused AI that uses both sets of training data.
      Indeed that is one of the uses of ontology models is to allow different system to be interoperable in that the ontology model serves as a data broker between the two so they can know what the other system's data represents.
      And there are such Ontology schemes such as OWL and RDF where in UniML I try to extend that to be more graphical in nature, like going from DOS to a GUI like how Steve Jobs did with the Macintosh from DOS on a PC back in the day.

  • @jobterhaar
    @jobterhaar 9 หลายเดือนก่อน

    Its abilities to create shrimps out of thin air are certainly impressive!

  • @blender_wiki
    @blender_wiki 9 หลายเดือนก่อน

    Tracer AGV can be replaced with cheaper and diy solution. Robot harm can be build also. In less than 2 -3 month a mod version of this project will caost 10k less. Also the realtime interference can be done with a less Power consuming HW or through a fix solution trough wifi.

  • @mr-biz
    @mr-biz 9 หลายเดือนก่อน

    How long will it be before we see these robots flipping burgers, cleaning tables, and serving customers at McDonald's?

  • @gotham4u
    @gotham4u 9 หลายเดือนก่อน +1

    Remote control magic

  • @mshonle
    @mshonle 9 หลายเดือนก่อน +1

    Let’s hope Nvidia might gift researchers with some Jetson AGX Orins! Comparable in cost to the laptop but could support 6 cameras (1080p at 60fps). I imagine other sensors like LiDAR, infrared, et cetera could aid in recording more ground truth and enhance adaptability.

  • @lasagnadipalude8939
    @lasagnadipalude8939 9 หลายเดือนก่อน +1

    I believe this is already enough to run autonomusly a hotel. A mixture of this and development from a company, I think it's totally doable In the next 2 years to spend the night in one.

    • @wege8409
      @wege8409 9 หลายเดือนก่อน +1

      I've seen a video of a place in Japan where the gimmick is that the staff is largely robots. Right around the corner

  • @kingstonchi
    @kingstonchi 8 หลายเดือนก่อน

    Also during training of the robot, half of the training should be by a left handed person, the other half by right-handed .. That way, the robot may excel above and beyond either of them ..

  • @jasontang6725
    @jasontang6725 9 หลายเดือนก่อน +1

    Industrial robots have been doing this for decades - repeating actions trained by a remote operator. I'd like to be enthusiastic about this, but it really just looks like 90% teleoperation, 10% repetition. If you pay attention, you'll notice that all of the demos are performed using teleoperation - in some, you can clearly see the operator in the background. You'll also notice the complete absence of adverse or unexpected circumstances from the demos. In the absence of 3rd party testing, skepticism should be the default.

    • @14supersonic
      @14supersonic 9 หลายเดือนก่อน

      One of the major appeals of this isn't necessarily the training method, but the fact that this is open source and fully accessible. Functionality can be added in and modified rather rapidly.
      It doesn't matter if the pilot has to do some work initially, that's the whole point. Skepticism is fine, but don't be so biased that you become hyper-skeptical.

    • @rog13
      @rog13 9 หลายเดือนก่อน +1

      There a re clearly no operators visible in the main demos (I just watched again to be sure). The footage at the end of the video however shows the training side of things, where people are obviously required to be operating it.

    • @jasontang6725
      @jasontang6725 9 หลายเดือนก่อน

      Fair enough. If it's real, then we should expect to see this replicated and improved very rapidly given it's open source. If it's vaporware, then we should expect everyone to forget about it after six months or so. I don't think it's hyper-skeptical to suspect the latter, but I'd also be pleasantly surprised to be wrong. Either way, we'll know soon enough.

    • @jasontang6725
      @jasontang6725 6 หลายเดือนก่อน

      Called it. Two months later and there's been zero activity on this project's Github pages. Just another staged demo of a vaporware project.

  • @foxdog9332
    @foxdog9332 9 หลายเดือนก่อน

    ...jesus christ its like a toddler trying to cook the shrimp...im good

  • @__--JY-Moe--__
    @__--JY-Moe--__ 9 หลายเดือนก่อน

    yup! nice 2 see! pretty cool! thanks 4 the vid Matthew! the bloopers were helpful!

  • @carnacthemagnificent2498
    @carnacthemagnificent2498 9 หลายเดือนก่อน

    This is how the Daleks started ... just needs a plunger attachment. 😀

  • @patricklambert4730
    @patricklambert4730 9 หลายเดือนก่อน

    What really brings it all together is the personification of the machine. You all saw how beautiful it's googly eyes were right?

    • @bigglyguy8429
      @bigglyguy8429 9 หลายเดือนก่อน +1

      The sexbots are gonna be a hit...

  • @aurorats138
    @aurorats138 3 หลายเดือนก่อน

    I want to buy those equipments and make one at home, for my son, who has problems with his hand and arm. I think with a certain amount of time on learning, the machine can make a massage daily. That'll be great helpful.

  • @michalchik
    @michalchik 9 หลายเดือนก่อน +3

    "Mock-Up"
    A useful word, that you should know for the forthcoming cycle of development and hype in the AI field. It is basically a fake, but use legitimately it's intention is to give everybody an idea of what the final version should look like and how it should function
    Basically it generally means, producing something that appears to function the way you intend something else to function. If you're making a program, or doing an experiment, or designing the scenery for play, or creating an invention to automatically function. You will create something that appears to be the real thing so long as you look at it from just the right angle, with the right editing, and there's a lot of predictable events or human interactions.
    So for example, let's say you're writing a program for a calculator. You might write a much simpler program that looks like a calculator, and always prints out the number "5" when you hit '=' and then during the mock-up demonstration you type in 2+3 = and it prints out 5 even though no calculations have been done.
    There are legitimate uses for mock-ups. Basically you can use them to make sure that everyone on your development team knows what you're going for. You can inform investors as to your goals and give them a practical demonstration of what you want it to do. You can test aspects of an experiment to make sure that it can actually detect the result of the experiment correctly, and I know they in fact did this with the gravitational observatories, they fed it fake data to see if it could actually identify merging black holes. I've done it in biology, where I've fed in fake experimental results into a gel and into a sequence analyzer to see if it could detect the real thing when I ran the experiment. This is sometimes called a positive control..
    It goes from a mock-up, to fraud when you represent it as real results obtained from natural inputs. If I say look my calculator can add two numbers, two plus three equals and a five pops out, I am misleading people as to whether or not actual addition is occurring. If I had presented my positive controls in my biology experiments as if they were the result of an experimental intervention rather than me custom designing DNA fragments to give a particular appearance, that would have also been fraud.
    Unfortunately fraud like that is really hard to detect unless you have independent people that have access to the same things and can verify your results as well as test for the assumed full range of applications.
    I do think that some of what Google did qualifies as mockup that they then mixed with semi legitimate stuff, creating what is properly called a fraud.
    Mockups are actually really useful tools and represent an organic part of the research and development process. They are also very easy to translate into fakery and fraud especially when there's a lot of pressure to get results fast and there's a lot of money on the line. You need people with a lot of maturity and a lot of integrity to use mock-ups properly.

    • @orangeraven3869
      @orangeraven3869 9 หลายเดือนก่อน

      He's just covering an academic research project. It's not like that team is trying to convince people to buy these research platforms with pre-orders.
      I get your point that it's not 100% proven and could turn out to be less capable or more limited than it looks. But they even showed the robot failing in the outro to drive home the point that it still fails sometimes right now.

  • @giosterr44
    @giosterr44 9 หลายเดือนก่อน

    These robots will implemented in basic settings like Janitorial positions, window-cleaning, and even McDonald’s!! To train the robots, you still need human interaction. This is implemented as a new position of ‘janitor’. So, to be a janitor in the future, YOU WILL NEED A COLLEGE DEGREE. THINK ABOUT THAT!!! FOOD FOR THOUGHT!!!! FUTURE, HERE WE ARE!!! 🎉❤

  • @matthewdozier977
    @matthewdozier977 9 หลายเดือนก่อน +1

    What makes this Google's breakthrough? It's a Stanford project, right? Did I miss something?

    • @AG-kh8dj
      @AG-kh8dj 9 หลายเดือนก่อน

      Exactly the paper is not even mentioning Google...

  • @equious8413
    @equious8413 9 หลายเดือนก่อน

    Don't really want a Macbook Grope rolling around. I definitely want a Spot robot dog though

  • @Thedeepseanomad
    @Thedeepseanomad 9 หลายเดือนก่อน

    Remember folks, advanced robotics and AI replicating human capacity for work allows for open sourced commons without the need for state administration and taxation. So we can finally have UBI type systems without leaching on the productive work and property of private citizens.

  • @NoName-ws9qv
    @NoName-ws9qv 9 หลายเดือนก่อน

    Robot is cooking the shrimp at too high a temp

  • @TanChoonHong
    @TanChoonHong 9 หลายเดือนก่อน

    Absolutely engaging and convincing proof of concept that can be built on a weekend. Amazing. The future is so promising.

  • @jimbob1er
    @jimbob1er 9 หลายเดือนก่อน

    wow, fully open source, something is starting there! I can see a lot of opportunity in cost reduction. Also it should be possible to train remotely with a virtual headset. Train it slow then accelerate on execution. Lets build a training dataset from the crowd! Some computation can be offloaded or improved by cloud computation. But it needs safety, it is not safe to launch an autonomous robot with humans. It may break bones, it may start fire... Actuators need to have a safe force limit and human supervision.

  • @controllerfreak3596
    @controllerfreak3596 9 หลายเดือนก่อน +1

    super cool. but can somebody please cablemanage that thing, please? Im getting itchy.

  • @rajeevgangal542
    @rajeevgangal542 9 หลายเดือนก่อน

    Reminds me of BBT. An arm is all you need, right?

  • @content1
    @content1 9 หลายเดือนก่อน

    OMG! this is what we had been waiting since the 80s!!! thanks god

  • @Parisneo
    @Parisneo 9 หลายเดือนก่อน

    bimanual manipulation is a very tricky task. HHH AI is a game changer in robot control. We'll all be put to retirement soon. To do that using classical robotics, it is extremely complex. We have built a bimanual robot and i know how hard it is. And they are very expensive. Waw, AI did replace many methods and Robotics are not an exception.

  • @BenjaminDirgo
    @BenjaminDirgo 8 หลายเดือนก่อน

    I don’t understand, is it learning and generalizing from the teaching steps? Like what if the towel wasn’t in the sink when it was cleaning up the wine?

  • @Sci-Que
    @Sci-Que 8 หลายเดือนก่อน

    5 years? Maybe not. Consider the pressure Mobile Aloha just put on the robotics industry as a whole to push for even better breakthroughs. Musk has to know about Mobile Aloha and I don't figure he will stand idly by while it outperforms Optimus.

  • @robertsutkowski3170
    @robertsutkowski3170 8 หลายเดือนก่อน

    0:50 WOW 😊👍

  • @Leto2ndAtreides
    @Leto2ndAtreides 9 หลายเดือนก่อน

    It needs human like hands - everything in the human world assumes that it's being navigated by humans.

  • @cesarsantos854
    @cesarsantos854 9 หลายเดือนก่อน

    10 years sounds like a good guess.

  • @빌리BILLY-e4h
    @빌리BILLY-e4h 6 หลายเดือนก่อน

    This is amazing work! How can you perceive depth with a 2D camera??

  • @quickcinemarecap
    @quickcinemarecap 9 หลายเดือนก่อน

    00:01 Mobile Aloha robot revolutionizes affordable robot ownership.
    02:12 Google's Mobile Aloha allows whole body teleoperation for complex tasks
    04:12 Robot with two arms and AI can perform tasks beyond pre-defined instructions
    06:17 Robot demonstrates autonomous handling of tasks
    08:23 Mobile Aloha extends capabilities of the original Aloha with low cost and dexterous manual puppeteering setup.
    10:33 Mobile Aloha is a breakthrough robot for whole-body expert demonstrations and teleoperation.
    12:39 Aloha system excels in tasks requiring coordination between two arms and movement
    14:35 Open-source tutorial for building a breakthrough robot with hardware and code instructions

  • @teknic111
    @teknic111 9 หลายเดือนก่อน

    I would absolutely buy one to cleanup after me and serve me in my home.

  • @wege8409
    @wege8409 9 หลายเดือนก่อน

    In a year these will be pretty competent I imagine, the problem with robots right now is the poverty of data. We should build like a million of these and share our datasets.

  • @MilesBellas
    @MilesBellas 8 หลายเดือนก่อน

    Longevity of armatures = issue ?
    There is no supporting "musculature" to reduce wear....

  • @tubebobwil
    @tubebobwil 9 หลายเดือนก่อน

    They had me at doing your dishes.

  • @Juttutin
    @Juttutin 9 หลายเดือนก่อน

    First we will see this in verticals like office cleaning and hospital stuff, just general cleaning, emptying rubbish bins, moving stock, delivering packages, etc etc etc etc.
    Wherever the facility is large enough and easily navigable to justify the upfront costs. It's going to be replacing minimum wage workers initially.
    That will drive the cost of robotic arms and locomotion way way down through mass production.
    Then we'll start seeing them in the kind of homes that have 85" tvs today.
    But it's gonna be game over for a ton of low wage workers in developed economies.
    8-10 years, mostly due to the economics and unavoidable time required for economic mass production to develop.