This AI Stuntman Just Keeps Getting Better! 🏃
ฝัง
- เผยแพร่เมื่อ 28 ก.ย. 2021
- ❤️ Train a neural network and track your experiments with Weights & Biases here: wandb.me/paperintro
📝 The paper "Learning a family of motor skills from a single motion clip" is available here:
mrl.snu.ac.kr/research/Project...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Haro, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bryan Learn, Christian Ahlin, Eric Haddad, Eric Martel, Gordon Child, Ivo Galic, Jace O'Brien, Javier Bustamante, John Le, Jonas, Kenneth Davis, Klaus Busse, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Mark Oates, Michael Albrecht, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: discordapp.com/invite/hbcTJu2
Károly Zsolnai-Fehér's links:
Instagram: / twominutepapers
Twitter: / twominutepapers
Web: cg.tuwien.ac.at/~zsolnai/
#gamedev - วิทยาศาสตร์และเทคโนโลยี
Two Minute Papers has taught me that when humanoid robots come for us, they won't be clunky C-3POs with stiff movements, they'll be terrifying masters of parkour.
@Train of Taught Great idea! I even have a name for it... ParkourMON
Boston dynamics has made me genuinely fear robots
@Train of Taught m.th-cam.com/video/a30K69hUJyo/w-d-xo.html
And there will be nowhere for us to hide (open ai hide & seek)
Just like Elon Musk said "AI is the true threat of humanity".
Something like this implemented in a game engine would be insane. Completely procedural animations for characters and nps would take immersion to whole new level
I'm imagining a fully physics based game where your character can actually trip over stuff like pebbles, or slip on things, and it would use completely realistic physics to simulate that. Might be annoying sometimes, but certainly more realistic.
@@R2Bl3nd Or perhaps even allow users to set the degree of physics realism if it gets annoying
Imagine that but in Mount & Blade.
@@R2Bl3nd exanima
@@R2Bl3nd death stranding
It's hard to believe that this is an actual physics simulation and not a motion-capture animation
Yeah seriously, what physics simulator is this? I’ve never seen it before. This is definitely not open source I would assume
@@cw9249 I don't think the physics simulation itself is that extraordinary, the reason why I think it's incredible that they put it in a physics sim is that modeling and controlling a human in a way that looks like realistic human movement becomes much harder when you're constrained by the laws of physics, and can't just record a movement that is just played back without being integrated into the world.
I absolutely love how confidently the agent fails, full commitment to breaking their spine on the ground!
Imagine, Boston Dynamics roboters with this technology. What a time to be alive (for now)
I think it is the same technology. It's machine learning right? Neural network based training?
@@user-ik8vy1rg8f yea it’s the same thing. They also use machine learning, so they will do something like show them how to do a course and it will do it. But it needs to learn how to keep its balance and everything else which it will learn through trial and error.
(For now) XD
Tesla bot will try this before them .
@@xxbatman69xx98 I've heard that they mostly don't use machine learning, and not much is known at all
Although they may be working on that at the moment
3:07 I wish I was cursed with that crazy configuration 😏
Haha hey there DoodleChaos! Love your vids =D
god
乇乂ㄒ尺卂ㄒ卄丨匚匚 configuration
I had that long leg / long arm configuration too. But my motor skills were buggy as hell and it had strength issues too. Fortunately there was a patch that increased the thickness of legs / arms too. That fixed the strength issues and my body runs much better now. But my motor skills are still shitting the bed during sports. 😂
pixar moms
Can't believe how Freeza got beaten so easily. WOW!
Video games with next gen AI are gonna be fire!
That’s because they took off his tail
You must have missed Trunks' intro in the Cell Saga
This is taunting me as I learn body mechanics in animation. By the time I can do it well, we'll have the 'animate' button
Switch "well" for "we'll" so that you don't confuse even people who don't care about grammar.
If you want to level it up again, put a comma right after "it". That will be even less confusing.
i suspect you said this as a joke but i think it should be a genuine concern tbh. make sure youre not investing your efforts into an industry thats going to vanish in a decade
There's no replacement for personal expression! :) no machine can animate like you personally animate, or even you in a particular mood or day.
I'm sure you know that, just wanted to say it, keep it up animation is awesome, it's really cool that you're doing it.
P3ople have said that stuff years ago sooo
I’m loving the pace of AI! I’m just starting off at college and with some influence from your videos I have decided to pursue a career in machine learning! You make such excellent work and I feel so inspired every time you post!
*(Watching two minute papers fills you with determination)
Holy crap, I've never seen such an explosive punch animated before. Not even motion capture can quite get to that level because the animation often does not translate to the physics of the game.
This paper keeps jumping all over the place, lovin' it !
😋 Narf!
Too true! I would have to classify the paper as a "technological leap". ;)
I feel that in the future, this is how characters will be animated.
I love the humor! keep up the amazing work, I've been following for years and I still click on every video!
I would love to have a video game where the character’s movement was determined by this AI so that as you progressed through the game the AI would slowly get better at the characters move set. By the end of the game you would be able to pull off moves that would have been unthinkable at the start of the game.
Trivia - The first sport to be incorporated into the AI-lympics was the high jump.
😄👍👍
The day it figures out the Fosbury Flop by itself is the day I believe AI can do anything.
@@emperorsascharoni9577 That was the first thing that came to my mind when the wall was raised! Either it hasn't figured it out yet, which is kind of weird as there have been papers earlier where virtual agents adjust their limb & joint configurations to most efficiently tread a terrain - OR - it's possible there's some sort of rule in place for it to preserve the vertical orientation throughout the movement. But, yeah, figuring out the fosbury flop will make it a lot easier for it! That'd be so dope!
Is no one going to comment about the fact that it looks like the model broke one of its ankles after every running jump?
I think that’s it’s “rebalancing” after the jump but it just does it very poorly.
It's because the before and after movement isn't being optimized simply the jump is. If the walking/running action were optimized it would probably get rid of that
@@mnomadvfx honestly I don’t know much about ai. But after seeing ai made in mine craft more complex then this it kinda degrades the fascination. And people’s are comparing this to boston dynamics is hilarious. Boston dynamics, besides for industrial use and military is the best quality you can compare to. And it’s not even there.
@@historyZZ you should've stopped after the first sentence lol
@@bukpuki please explain how ai on a software is more fascinating then the software on real life robotics?
Amazing! I won't be surprised if in a few years we will have AI-based workout apps that suggest highly customized exercises based on your body type and body mechanics. Indeed, what a time to be alive!
Yes
Woahhh, this would be an incredible use for it.
I was also thinking it could be used as a way for Olympic athletes to hone their techniques.
Makes no sense
Machine: “jump higher”
You: “how?”
Machine: *plays video of sim jumping over a sky scraper
“It is possible”
You: *weak, sad, shuddering
yes, master.
I thought it was going to spontaneously re-invent the Fosbury flop. No such luck.
I think here was a previous AI that did it. This one was specifically told to use the same move.
Do you notice the walking motion after the jump is very awkward? It seems to be dragging its legs forward with stiff ankles
Notably that awkward walking motion was already in the reference! So it probably learned that and had no reason to "unlearn" it (i.e. its presence didn't affect the fitness function).
I got sad for the AI hurting its ankle each jump
Yup, to me, the biomechanics seems wrong for humans but adequate for manikins being simulated by AI.
Probably because the bot is devoid of pain sensors and it's bones and joints are indestructible, so there's no need to improve landing posture to minimize negative impact on bone and joint integrity.
Exploration like this is what could help AIs play games too, refining independent tasks and not just trying to achieve a high score in a long run
Not all games even have scores. And the AI that plays old Atari games can finish those, too.
@@davidwuhrer6704 I was referring to the fitness function in neural networks for playing
I can imagine this being used for movies, animations and even games where characters learn new moves while playing! That sounds like such a amazing thing. I'm excited for the future.
A game in which the player character improves movement over time would be amazing.
In Assasins' Creed, the player avatar adjusts movement to the environment, but it is pre-captured motions stitched together.
In GTA San Andreas, the player avatar can change its body shape depending on food and exercise. This then changes jump height, running speed, lung capacity, and how many hit points a punch subtracts from the target.
I'm thinking a game in which the player avatar acquires new ways to adjust movement to the environment and to changing body shape would be quire exciting.
A completely different thing would be AI agents learning movements from each other. There are many possible gaits, for example, which could propagate as memes through a population. I'm not sure how to make a game idea out of it, and it would be a lot more computation intensive, but I think the concept has potential.
that jump on 0.3 gravity looks so happy.
Is there a channel dedicated just for this content? It's incredible watching this evolve!
I wanna see 2 AIs fighting each other. That would be insane.
This is the best thing I've seen in my life! This AI opens so many possibilities!
This is honestly so incredible. Very useful for video game devs! Imagine, each pixel used to have to be colored in, per frame, then we got into 3D, but every single move had to be precision placed by an animator, and now and into the future, the AI will just do it all for us. We say do X, AI will do X in 1 trillion different ways. I love it. I absolutely love it all. Thank you yet again for an awesome presentation of what's going on in these fields, Two Minute Papers. :)
This is really cool, well done guys who made this! Well done!!!
Sometimes the world is too much but this channel always makes me happy to be on the planet regardless of what's falling apart.
...or go full Mike Tyson on the opponent 😂
Bite off an ear?
That's very similar to what Mike Tyson does actually, look at what it does with its legs and compare it with Mike. Crazy!
2:04 including phasing through solid blocks
Absolutely incredible! What a time to be alive!
I really love how u present these papers man; idk- don't ask me to describe it
u are just amazing sir...in the most geeky (in a good way) one can possibly say
ty for capturing the excitement in the most appropriate way- bravo
I love your channel so much, I’ve been watching your videos for months and haven’t even started college yet
I just love this man's voice he is so cool!
Poor guy looks like he did a hammy after the first jump
I'm addicted to your voice. Absolutly amazing.
It would be very cool if a model would also predict its own risk of failure, and decide "I'm not going to make this jump, so I'm not going to try".
Really interesting to see its applications in the future
Is this impressive? Yes. Yes, it is.
It'd be so cool if everything on this channel was somehow implemented into 1 game.
Like, a full game with realistic physics, ai optimized graphics, ai character movement.
This is a very interesting future we're moving into.
The perfect quintessential 2 minute paper video I love this channel so muuiuacacajajja!!!!!
Great video. Thank you!
Now stick this into Disney's robot aerialist.
2:22 - I would absolutely LOVE to see an AI fail video! It's always so hilarious to see these little failures, pure physical comedy gold!
first time me attending your video uploaded 1 minute ago, cheer up Doc!
I'm gonna have to read about this. Hopefully it's good enough to run in real time because I'd love to see this stuff put to work in making a video game where the main character moves much more fluidly.
I think it is, they control it with a controller at some point.
Interesting how the model character slows down before each obstacle. A human would use his/her momentum with anticipation for the next hurdle as soon as the previous one was complete.. The AI bot seems to rely on her muscular structure and close-up evaluation of each block. I would suggest adding to her programming the ability to analyze from more of a distance or to analyze the entire course before she begins her movements.
Ah i always love machine learning and seeing them adapt to different situations
I LOVE THESE VIDEOS AAAAAAAH!
as a 3D artist and animator this papers amaze me so much, what a time to be alive!
Congratz on the million followers
thanks for putting subtitles so i can watch your videos.
The best statistics channel on YT :D
Fantastic!
It just keeps Getting Better!
Simply amazing 👏
Next step : Put this class of algorithms in the brain of Boston Dynamics' robots
Amazing!
One of the best episodes yet, I still have no papers though.
Today I learned that Professor's name is spelled - Károly Zsolnai-Fehér
.
Amazing thanks for sharing
Move over, Boston Dynamics Atlas. There's a new kid on the blocks.
Would it be possible to develop a bot that boxes like Tyson at his peak, another that boxes like Ali at his peak, and set them against each other to see who would win?
I can imagine people actually having boxing matches with different trained AI. Maybe WWE AI as well. Would be dope.
Yeah
I guess, but you wouldn't know the specific preparation and strategy each would apply, or the plans each would have. There simply isn't enough data to understand that, particularly if you are trying to hit a specific moment in their career.
i like how in the first video after the jump it walks like if it had hurted
I imagine that being soo cool to have in games.. your character could realistically move as you created him .. and also adapt to the environment, man ..can't wait to see what future games look like :O!
Unreal has a system like this. Its already soo advanced.
00:54 When he said "hold on to your papers" I was expecting the figure to have demonstrated convergent evolution and used the Fosbury flop!
They're coming on very strong.
"..but, do you know what else it can deal with?" obviously our sponsor... oh ohh.. "hold on to the paper, squeeze it"
I fuckin love this channel.
What a time to be alive.
Once I played PONG on our TV back in the 70's or so. Who would ever believe back then we could get to this level.......................
Supper COOL.
Isaac Asimov, that's who.
Of course hardly anyone believe him back then.
this is what the game Indurstry needs and not fancy graphics! I love these kind of paper!
IMO, it needs neither, games are about entertainment, not realism, it's not like we can't do smarter AI for games, we just decide not to because it wouldn't be fun
@@geli95us games like gta would 100% be improved by having this because it wouldnt constrain u to just a few ways of hitting and breaking cars you could choose 1000s of different animations or even train the thing yourself you would have more climbing things like that
Love this cannnnnnel!!!
Incredible
Amazing 🤩
Two papers down the line and we will be hooked to AI MMA
3:19
"Baby Legs, here we go!"
[Baby Legs makes whirring noises]
"That’s the sound I make when I’m trying to run fast."
― Baby Legs Detective (Rick and Morty)
This was excellent!! Dr.Karoly, could this test tell us then a more theoritical upper limit to the 100 sprint and also determine the best body shape to do so? That would be fascinating.
Wrists of steel
i cant wait for future
The bot sort of has a zombie shuffle after hopping over the wall.
4:24 - I love that WHEEEEEEEE pose, lol!
It's learns like a human with no physical limits
YAH I LOVE THE DOCTOR I AM HOLDING ONTO MY PAPERS.
It's all very entertaining until robocop chases you down and punches a tunnel through your ribcage.
Imagine a game similar to this, and with your skill level raises the pa(Procedural animation)'s capabilities. like without a level you can do basic jumps, climb things, etc.. but with a higher level you can do all kinds of different jumps, vaults, and swings.
Dear fellow scholars,
This is Too Many Humans, with Károly Zsolnai-Fehér. Wow! What a time to be simulated!
What a time to be AI!
Mind backups, when?
love it
Hopefully they'll be able to compute the failure consequence in the movements to hopefully offshoot some of the damaging effects, but then again that could limit some of the requirements suggested to make a successful climb indefinitely beyond certain generations.
This would be great for npcs in games that don’t have a predetermined path to follow
0:42 1:07 oh gosh, the left leg's limping though
2:17 geez, it's suppper prominent and beyond the scope that i can ignore it
Boston Dynamics wants to know your location with Bags of CAsh .
My favourite paper the AI stuntman!
Changing body proportion is interesting, but how about just one arm longer or one leg slightly shorter instead of both?
...Would it still be able to cartwheel or do the other tasks?
probably yes, each one has its movements calculated individually, just like the legs. This categorization of arms and legs for an AI is more a human concept than an actual code thing
Boston Dynamics: 📝👀 mmmmm interesting "AI punch"
Now i'm dreaming to 3d print a full body robot in real life and have the IA takes the control of the body ! 👌😆
Oh god, the Ikea employees know parkour!
How fast does this simulation run? Can this AI be used to control / animate NPC's in a video game?
Not in real time I assume
amazing
This is poetry