Learning Robust Autonomous Navigation and Locomotion for Wheeled-legged Robots
ฝัง
- เผยแพร่เมื่อ 23 เม.ย. 2024
- In our new Science Robotics paper, we introduce an autonomous navigation system developed for our wheeled-legged quadrupeds, designed for fast and efficient navigation within large urban environments. Driven by neural network policies, our simple, unified control system enables smooth gait transitions, smart navigation planning, and highly responsive obstacle avoidance in populated urban environments.
With the Swiss-Mile prototype robot, we have conducted kilometer-scale missions for months and proved the feasibility of our system for real-world applications.
Project website: junja94.github.io/learning_ro...
Paper link: www.science.org/doi/10.1126/s... - วิทยาศาสตร์และเทคโนโลยี
Wow! this version of robot dog is amazing!!
Thank you 🙏 there are many more videos of the robot. Even standing on two legs 🤘
Good job! When it's in all wheel mode, maybe you can use some mechanical locks to fix the joints to save more electricity for the acutator on these joints. Keep only the necessary ones unlocked for steering left/right
The ones moving the legs up/down act as a kind of suspension from what I can see. Locking those would only be possible on mostly flat terrain
Good idea 👍
@@lolzdatguy4987 A lock pin with a piece of rubber, crusing on "mostly flat“ terrain :P
or just turn these axis into an end stop so motor power of these actuators can be turned off. A position with the main body close to the ground to also reduce aerodynamic drag
Speed, climbing and jumping !!! That's amazing !
Thank you 🙏
This is a game changer in autonomous navigation. Kudos to the team who made this possible.
Thank you 🙏
Congratulation 🎉 to the team who designed this revolutionary concept of locomotion.
It was "The Wheelers" in the movie Return to Oz (1985) with Fairuza Balk. They are awesome characters, and this needs to be dressed in that costume.
We have arrived at the template for autonomous public carts. Finally something that works
Haha finally :)
INCREDIBLE DESIGN
Glad you like it!
Amazing work guys. Been following your progress for a long time. My favorite robot dog of all!
Awesome! Thank you!
Good job guys!
Thank you
This is brilliant. I absolutely love the combination of wheeled and legged locomotion, and the way they interact and complement each other, not just switch. Can't wait to see these things learn and become more agile and graceful.
The wheels even help when going up the stairs :)
@@leggedrobotics Exactly. If you guys keep at it, the thing will be hopping and leaping around like a mind-blowing wheeled gazelle. 😊
Man, that looked like one badass transformer...🔥🔥🔥
🔥 🔥 🔥
I love the idea. Pure leg-walking is so inefficient
Agreed 👍
Impressive policies! Amazing that the policies learned in simulation transfers to the real word
We know how to transfer it :)
@@leggedrobotics Cool I'll check the paper!
This would be a really good replacement for the current food delivery robots, which are far too slow to outrun people with malicious intent!
If this is real (ie, not CGI) then it's very impressive. What troubles me is that robot voice. It lends a synthetic air to the entire video.
It’s real :)
Oh shit! It's like a robotic Wheeler from Return to Oz.
Exactly! My childhood nightmare is now real 😂
The wheelers are coming 🚴
incredible, this needs further funding, improvement and to be sent to Mars
Our spinoff Swiss-Mike is taking care of that 🤘
I've always said that the robot that we will ultimately use for general purpose won't look like a human and have normal fingers and legs. If you gonna build something to physically assist us why start with a human frame with its known limitations. These guys have it right. Take the best parts of as many species and vehicles as possible.
That’s correct! Do not copy nature if we have different tools to build machines.
우와 충격적인 관절과 대응 타이어에 변화에 대한 허용범위와 대응 그리고 타이어는 바로 정교함에 여유를 주는 요소이고 관절대응은 정말 인간을 넘어서는 순발력이네요 연구진들 대단합니다.
Thank you 🙏
Great job. The combination of modes is amazing!
Glad you think so!
very cool work excited to see how anymal has progressed over the years and for what comes next
We will try to keep up the pace!
Cool, make one with handle bars and a seat please
Good idea. The next gen motor bikes 🚴
SURE GrandMuters diving Robots lolz
BETTER MAKE it pull a Fairytale carriage
This would be great for a handicapped person to gain more mobility.
Smart! Can’t believe this isn’t more common
We are the first mover!
Don't worry, robot world domination is coming to us soon enough!
This is such a joy to look at
🥰
very smartly done !
Thanks 🙏
if such a robot is much more economical than a robot on legs, then your idea will definitely win in the future!
Fingers crossed 🤞
I'm just in love with this thing, i don't get why everyone makes robots with normal feet when you can have this and waste less energy and be faster, especially if you can switch configuration. Are feet just more stable at this stage of learning?.
People like to copy nature
Wow. Fantastic
Thank you 🙏
ETH is top!
This is getting better and better.
💪
Easily the most advanced robotic dog platform!
🤘🤘🤘🤘
This looks like a winning design.
Thanks 🙏
Lol, Wizard of OZ! That robot is really strange and cool. You can see it processing walk or rollkneecaps.
It also needs kneepads. It was bumping its poor knees.
Looks a little clumsy, but with more time machine learning, I bet it will be awesome!
It already has knee pads :)
this is the ultimate solution for robot legs. felixable like human leg, faster than human leg
I like the slogan at the end
Incredible design! Color me inspired
Thank you! Cheers!
Looks like something you’d see in the “Tales from the Loop” books
I'd love to know how you picked a scalable framework. Looks great.
What is the runtime for this robot before needing to be recharged? I could see something like this doing security for a compound, or, search and rescue etc, but only if it had several hours of charge
Our startup Swiss-Mile is commercializing the robot for security. Their new robot can run for 5h.
“Wake up babe, new Robotic System Labs: Legged Robotics at ETH Zürich video”
Wake up babe.... someone posted wakeup babe meme again...
That’s right!
love it keep the good work going❤
We will 🤘
Quite a phenomenon in the last few years.
Thank you 🙏
Autobots.... Roll out!!!!
Autobots are becoming real 🤩
This idea is impressive. I wonder how much this can extend the battery life compared to full walking mode.
By a factor of 2 and more that’s 3 times the distance.
Amazing! Now bombs are 10x faster in 10 km of autonomus range! ❤
That’s bad 🙅♂️
can you train it to skate along like an inline skater? I could see it hitting narrow gaps just balancing on one side and tucking in the the other wheel set
We did that already. Check out our other videos
The iterations are visibly distant from one another in thresholds and competence. And it's still accelerating.
Exponential growth!
Здравствуйте, Подскажите, пожалуйста, А могли бы установить кресло для инвалидов на этого робота? Интересно посмотреть, какой вездеход ступенькоход получится для инвалидов - колясочников.
We will try our best to achieve that 🤞
this is absolutely impressive
Thank you 🙏
Anymal is such a great platform.
If I were an engineer I'd definitely use wheels, but I'd make them be able to either lock to become just the end of the leg, or pivot out of the way. Relying on just the motor to lock the wheel gives the robot a less stable footing in some situations. Be groovy to teach the robot how to move with its wheel when that's the most efficient, but use feet when the wheels are an impediment. Like the Tachikoma on Ghost in the Shell. (The smart spider tanks. I imagine all the developers on this project are into science fiction).
You can always become an engineer :)
Next-Level
Thank you 🙏
why not make the robot able to lock the wheels when going up stairs or such?
Because the wheels even help when going up the stairs. The robot merely rolls over the edge of the step.
Amazing ❤
Thanks 😄
YAP ! Wheels/legs combination is the best for robot moving, if I make robot it will do the same.
Exactly 👍
woo! this is great.
💪
This is excellent work! Have you published your source code and trained models?
No, sorry
The future has already begun
Finally
Does it give a precise control over the distance it moves?
Yes
Lassie is onto it.
What does this mean?
Good video!
Thank you
They need to be strong enough to arm them with Panzerfaust and Tank Killer Rifles, first strike and fixed defensive positions are perfect for these killer robots
We do not add weapons on our robot!
So how much is it? You can also put a saddle on it
Yes 🙌
Why is there a unitree B1 or B2 clip at the very end?
The company Swiss-Mile started to commercialize an adapted version of unitree.
хочу себе такой, с местом для пассажира, с джойстиком (или еще каким устройством для управления, конечно чип в мозгу был бы прекрасен)
We will work on it.
The competition of robots.
Let’s make them a reality ❤️
They stepped progress into hyper drive mode. 😂
What does this mean?
I spotted Sarah Connor in the background in the distance.....👀
Haha so you must be German to know Sarah Connor
I wonder how this would function with mechanim wheels on it aswell
It reminds me of the wheelers from the movie return to OZ
It’s a great movie 🎥
True yes
Wow! AKIRA 炭団 has been realized
Finally!!
'Return to Oz' nightmares
They are coming back 🤯
Aren't you guys using the Nvidia Omniverse for simulation?
This work uses the one that was developed in-house.
Probably a naive question, but why don't we use both legs and wheels together? wherever legs are better then wheels can be folded up likewise legs.
It is using both even when going up the stairs.
This is the way
"Best of both worlds"
every day you know new artificial form of life automatized
So, Metalhead is gonna have wheels in this timeline of Black Mirror? yay
This will become the good version of metalhead :)
Agora testa numa favela aqui no RJ
Next challenge!
❤❤❤
❤️❤️❤️
It will be cool when it's real. Notice the blurred image around the robot. Seems very CGI
Haha no CGI
You should make it so that the wheels can change from wheels to stilts or something so it can more efficiently go up stairs or hills
Ps. If accomplished then in theory the robot could be able to walk 😅
Actually by using the wheels the robot can roll up the stairs and be more efficient depending on the kind of stairs.
@leggedrobotics I mean I'm not saying it can't but I noticed it skirted a little going up those stairs, so idk maybe more grip but I still think the ability to go from wheels to walkers wouldn't be a bad idea especially if you want the robot to be more versatile, NOT hating LOVE THE BOT just saying thanks for responding 👍
Great progress on the robot. But why the AI voice? :(
Good question
What’s the battery life like?
It depends on the mission. Roughly around 2 hrs for the missions in the video
@@leggedrobotics not bad.
2:13 Terminator detected
The dog or the robot? 🤔
@@leggedrobotics 🤖
Id like to see one that skates on ice.
Good idea!
That thing is nothing but another moving target...
*THE WOODS AIN'T SAFE!*
😂
какой ёмкости аккумулятор, какой расход энергии ?
Check out Swiss-Mile the startup. They have now 5h. :)
Fuchikoma predecessor
👍
Exactly
Please Have one pull Fairytale Carriage
We will!
Nature is precius
Agreed 👍
지상 드론 같은 느낌이다.
True
this is just irl Puppytruck by Sean Dick
Haha
scale that up for my iron horse.
Why?
Just skip the wheel motors and have it rollerblade around!
The first robot we designed 7 years ago had rollerblades. There is a video of it on our channel.
Hello how make dansing
Next time :)
i need a car like this plz 😨😨
How much are you willing to pay? 🤔
@@leggedrobotics
lets make a deal? i brought up the idea to turn this epicness into a car and then you will make history. Youre company will be remembered for the first to make the legged robot car. Therefore i think i deserve at least one of the first you sell?✔✔
I enjoyed the robot, but was thrown off by the ai narrator. Its okay to use an ai narrator, but use a better one. And please dont have him read the titles in your script.
Thanks for the feedback. Next time, we will use a real voice
@@leggedroboticsThank you!
That. Look 5
@@leggedrobotics As a professional voiceover artist for the last 10 years who's been seeing less and less work due to AI, thank you
I offer my voice free of charge🤙
now, put on flamethrower on it
Never! We only make robots for good purposes.
@@leggedrobotics I was joking 🤣
Tachikoma, version 1
Exactly
ohh noo ooohhh nooooo Return to Oz becomes reality!!!
Yes 🤩
wheels on legs. there is a hunagrian expression about this: "iron ring.. from wood."
What does it mean?
@@leggedrobotics It roughly means it's pointless to attempt something when the original solution-in this case, the wheel and the leg on their own-are better solutions. And in addition, the caterpillar track, which has existed for 100 years, is perfectly suitable for such tasks but much simpler and cheaper.
Early tachikoma.
It’s just the beginning
"challenge our imagination"... pretty sure pretty much everyone has thought of this before.
Does that mean that it doesnt challenge your imagination? 😅
Thinking about it and making it work like in this video is a difference of 6 years of research
Not sure if you know this, but wheels have been a thing for a long time. Also the idea of putting them on a robot predates Me. So it's a good idea, but the claim that it challenges the imagination... falls a bit short. @@leejunja
6 years isn't that bad. Boston dynamics has been at it much longer.
Practice and imagination are different places, and we've seen this concept since 1998 with aibo. Don't get me wrong though, love to see, I'm just complaining about the wording.@@leggedrobotics
It is still challenging, no? We are not claiming that we invented this. I dont get your point.