the funny thing about reinforcement learning people is they say the advantage of rl over mpc is "you don't need a model of your dynamics" but then immediately say "we train it in a simulator [with a model of the dynamics]"
Exactly! The dynamics are for the simulation people to worry about. Assuming you didn't write your own simulation, and if you have money for real hardware then you probably didn't.
whats your point, you train it with simulator for convenience, you still have to train it in real life afterward, point being the algorithm it self does not require model
I just wanna appreciate how much effort goes into making and editing these videos and pushing out regular uploads. This was apparently shot on July 13 (8:50). Really appreciate the content and really great video as always!
One thing I've always noticed is that the robots always seem to have the same power to the actuators all the way through the motion. You can take your arms and swing the lower part around without using any muscles in your forearm by hanging it down and using your upper arm to swing it back and forth. I have never seen a robot where you can do that. Why is this important? It is important because it wastes a lot of effort and energy. It also causes robots to be stiff and jerky compared to humans or animals where you can describe a lot of people and animals and graceful. When is the last time (the answer is never for me) where you saw a robot be graceful? I think that is one of the biggest reasons why robots will not "seem" like humans anytime soon unless they stop powering every second of an action. You do not strain your muscles unless you are lifting or moving a heavy load. Robots always seem like like they are using maximum effort for everything they do. If we did that with our bodies we would be exhausted and need to lay down most of the day or we would develop much bigger or stronger muscles with more endurance. Instead our brains have learned that you don't need maximum effort all of the time. In fact, --most-- of the time you do NOT need maximum effort. Instead you most often need less than half and in many cases less than 25%. I'd love to hear thoughts on this about potential smoothness of robots so that they would be a LOT more graceful AND for energy savings that could be had in this area.
I agree, very interesting point! I can imagine engineers will find a way to improve robots graceful movement. Although I feel uncanny about it, would be quite a spectacle. Imagine what this could do for the entertainment industry and practical effects. A giant robot spider or T-rex!
Yes, I think if they train the robot to limit energy usage and also train to limit the force on the actuators then a robot will become more graceful and walk more naturaly
Not true, motors used in robots can generate torque proportional to current which can be any current value. The problem lays into control alghoritms because its very hard to implement
That's because the actuators are not muscles and give total control at every point. If we had different actuators than rotating geared motors you could do it differently. But there isn't anything else that's a useful size and power.
They're already on the market or you need to wait a while for walking ones, dependent on the details of what you want. Walking and having constraints like that is tough.
Sorry, so once again - what do you do specifically? You replicate what boston dynamics did, but from scratch? And why couldn't you use the spot or other models? Why can't you use that chinese model (forgot the name, unfortunately - you can look it up in the news) unveiled not so long ago?
@@tomfoolery2913 No, but from the software development perspective - it is reinventing the wheel/bicycle, isn't it? Even for the purpose of research - why not using something that is already there? Unless you have your own idea for one billion dollars...
4 leg robots seems to be a mistake. 4 legs are an accident of history, and never came from walking anyway. It seems that if you've got a many legs as you want, 8 is near optimum. Everything evolves into a crab. Watch an Australian huntsman spider hunting. It's awesome.
For ongoing learning you'll have to have it 'bruise' its brain! Every time it falls some random number gets installed... that's how neural networks learn... there has to be pain (or death!).
coyotes are well known to communicate mainly with written signs on a pole.
I wish I'd thought to include that in the animation, or at least a painting on a tunnel :) -Sean
the funny thing about reinforcement learning people is they say the advantage of rl over mpc is "you don't need a model of your dynamics" but then immediately say "we train it in a simulator [with a model of the dynamics]"
Exactly! The dynamics are for the simulation people to worry about. Assuming you didn't write your own simulation, and if you have money for real hardware then you probably didn't.
whats your point, you train it with simulator for convenience, you still have to train it in real life afterward, point being the algorithm it self does not require model
@@oldcowbb The point is that those people are hypocrites for saying they don't need a model of dynamics.
@@woulfhound 'doesn't need' is not the same as 'doesn't need but uses one anyway for convenience and speed'. Not hypocrites.
I just wanna appreciate how much effort goes into making and editing these videos and pushing out regular uploads. This was apparently shot on July 13 (8:50). Really appreciate the content and really great video as always!
Loving computerphile's foray into robotics!
9:11 Did you see that thing!? -so human like
One thing I've always noticed is that the robots always seem to have the same power to the actuators all the way through the motion.
You can take your arms and swing the lower part around without using any muscles in your forearm by hanging it down and using your upper arm to swing it back and forth. I have never seen a robot where you can do that.
Why is this important? It is important because it wastes a lot of effort and energy. It also causes robots to be stiff and jerky compared to humans or animals where you can describe a lot of people and animals and graceful. When is the last time (the answer is never for me) where you saw a robot be graceful?
I think that is one of the biggest reasons why robots will not "seem" like humans anytime soon unless they stop powering every second of an action.
You do not strain your muscles unless you are lifting or moving a heavy load. Robots always seem like like they are using maximum effort for everything they do. If we did that with our bodies we would be exhausted and need to lay down most of the day or we would develop much bigger or stronger muscles with more endurance.
Instead our brains have learned that you don't need maximum effort all of the time. In fact, --most-- of the time you do NOT need maximum effort. Instead you most often need less than half and in many cases less than 25%.
I'd love to hear thoughts on this about potential smoothness of robots so that they would be a LOT more graceful AND for energy savings that could be had in this area.
I agree, very interesting point! I can imagine engineers will find a way to improve robots graceful movement. Although I feel uncanny about it, would be quite a spectacle. Imagine what this could do for the entertainment industry and practical effects. A giant robot spider or T-rex!
Yes, I think if they train the robot to limit energy usage and also train to limit the force on the actuators then a robot will become more graceful and walk more naturaly
Not true, motors used in robots can generate torque proportional to current which can be any current value. The problem lays into control alghoritms because its very hard to implement
Check out experiments by Prof Deepak Pathak at cmu
That's because the actuators are not muscles and give total control at every point. If we had different actuators than rotating geared motors you could do it differently. But there isn't anything else that's a useful size and power.
We're getting closer and closer to robot humanoid cat girls. Hang on tight boys it's just around the corner.
I love you
Ew🤢
We’ll just wind up with another source of complaints.
They're already on the market or you need to wait a while for walking ones, dependent on the details of what you want. Walking and having constraints like that is tough.
Nice video! I think with robotics we are at same point as with computers back in the eighthees.
Nice to see Ubuntu desktop in that screen cast
Has anyone tried to gather all the information from CGI data mapping human motion to use for creating algorithms for models of robotic motion?
Yeah that's called imitation learning. It's not quite that but it's very similar
yes, a lot, to determine how the skeleton does its thing. Mapping from one to the other is hard because the actuators are so different.
Remember this video when one of these is chasing your family down the street.
although if that doesn't happen blame a politician--who will have made the decision to make them aggressive--rather than the roboticists.
This guy is working on legged robots and zuckerberg can't even get legged pixels to work on a computer
Cgi is often harder than real life lol
Nice exhibition, συγχαρητήρια :)
Beautiful.
leg moment
Not FSD yet then.
Neural networks running potentially self replicating robots… what could possibly go wrong?
Surprise NDA ending?
what
You must put parendev motor + alternator, so your robot alive 50 years non stop.
Έλληνες παντού!!!
🗿
Looks like you use Roblox to make models lol
pr໐๓໐Ş๓
Sorry, so once again - what do you do specifically? You replicate what boston dynamics did, but from scratch? And why couldn't you use the spot or other models? Why can't you use that chinese model (forgot the name, unfortunately - you can look it up in the news) unveiled not so long ago?
Would you say that there should only be one car company because Henry Ford made the model T?
@@tomfoolery2913 No, but from the software development perspective - it is reinventing the wheel/bicycle, isn't it? Even for the purpose of research - why not using something that is already there? Unless you have your own idea for one billion dollars...
It's already 2022 and robots are still so lame...
4 leg robots seems to be a mistake. 4 legs are an accident of history, and never came from walking anyway.
It seems that if you've got a many legs as you want, 8 is near optimum. Everything evolves into a crab.
Watch an Australian huntsman spider hunting. It's awesome.
it can't be an accident if it happened multiple times.
@@dibbidydoo4318 but 4 legs has only happened once.
@@gasdive would 8 legs allow for running/sprinting?
@@aceman0000099 they seem to. The Australian huntsman spider is *incredibly* fast. They don't spin webs, they chase down their prey.
They run at about 5m per second. It's mind blowing to see.
For ongoing learning you'll have to have it 'bruise' its brain! Every time it falls some random number gets installed... that's how neural networks learn... there has to be pain (or death!).
the "pain" is encoded as negative reward
ANYmal ? MAL ? Really ? Why not just skip to calling it Death Dog 9000 /s
NOT COMPUTER RELATED REPORTED FOR ABUSE