These AI-Driven Characters Dribble Like Mad! 🏀
ฝัง
- เผยแพร่เมื่อ 31 ก.ค. 2020
- ❤️ Check out Weights & Biases and sign up for a free demo here: www.wandb.com/papers
❤️ Their mentioned post is available here: app.wandb.ai/cayush/pytorchli...
📝 The paper "Local Motion Phases for Learning Multi-Contact Character Movements" is available here:
github.com/sebastianstarke/AI...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bruno Mikuš, Bryan Learn, Christian Ahlin, Daniel Hasegan, Eric Haddad, Eric Martel, Gordon Child, Javier Bustamante, Lorin Atzberger, Lukas Biewald, Michael Albrecht, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Ramsey Elbasheer, Robin Graham, Steef, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh.
If you wish to support the series, click here: / twominutepapers
Károly Zsolnai-Fehér's links:
Instagram: / twominutepapers
Twitter: / twominutepapers
Web: cg.tuwien.ac.at/~zsolnai/ - วิทยาศาสตร์และเทคโนโลยี
That “what a time to be alive” instantly slapped the depression off my face. I love this channel. I hardly understand anything, but I learn so much just by the way you explain concepts. Thank you for all this.
You are very kind. Reading these papers gives me a lot of joy and I am delighted to see if it goes through for you Fellow Scholars too!
You can press shift+enter to jump to a new line
cat I typed it on my phone and the ui just doesn’t work. (Sorry everyone)
cat just press enter. Why the shift? I always just press enter on desktop and mobile
@@bluebaconjake405 Shift + enter is a soft return as compared to enter on its own which is a hard return. So, pressing shift + enter is guaranteed in most cases to give you a new line in applications where pressing enter on its own may do the same thing as pressing the "ok" or "send" button.
"0/10 not enough microtransactions"
-2k games probably
I think you mean EA
@@cmdrblaze6487 LMAO you don't know 2K Basketball games then
@@remyshea954 "LMAO" what is this response...
@@sceplecture2382 dude are you like 40 years old holy shit
@@ThugHunterfromIsrael LAUGHING MY ASS OFF
I have a feeling that this is the “2nd paper” that we so often think about
even if it is the 10th, there will certainly be two more papers for movement based machine learning in the future.
@Solve Everything its now 5 minute papers haha
Wtf is 2nd paper
@@ctrey8395 this ^
@@ctrey8395 I hope, in this case, second paper is someone using this to enable easy generation of generalized game animations, especially for close melee combat. This seemed to have dynamic interaction components at multiple levels... we can definitely expand on that element and make this into a full general kinematics AI or something... I'm not sure
I imagine that this will eventually lead to something where you can customize the behavior of animations in a very generalized manner, especially if it's possible to somehow implement something similar to the technology that allows painting landscapes by simply defining regions. I wonder what we would get if we trained it on stylized animations as well.. such as in smash.
AI: making nerds care about basketball, what a time to be alive
Haha nice
more like badass geeks instead of nerds
Dude these nerds gonna sell these tech to 2K21 and get front roll seats of NBA for life.
@@zhehaoshen3635 but then they gotta sit through basketball, better to use the money on ttrpg source books and figures
@@tuseroni6085 A level 35 Micheal Jordan enters the dungeon, with his max out dunk skill, he can one hit kill any Laker type monster.
Looking forward to this making it's way to indie game devs, for all sorts of things besides basketball. When innovative gameplay can also look REALLY natural, and maybe even be mutually influenced by the results of using these learning methods, all for very little cost, I think we'll have an explosion of righteously cool experiences to enjoy =)
Unfortunately. "This project is only for research or education purposes, and not freely available for commercial use or redistribution."
Looks like a hybrid of machine learning and motion matching
@@FlynTie everything starts as "for research", we'll get practical applications of such methods eventually.
The algorithm is accessible. The project is for research, but it's just a matter of time until commercial aplications start showing up. Imagine indie companies being able to create the same ammount of animations that a game like Red Dead Redemption has with just a couple of bucks.
@@FlynTie Not sure how feasible motion capture data and techniques even are for an indy developer. Seems out of reach anyway.
"this good boy is pacing and running around beautifully"
The motion is so realistic, NBA 2k games seemed they are sliding and dragging their feet. This one is perfect
I was thinking about something similar to this the other day. When you have a certain number of idle animations created for a character, normally, as soon as the player moves the character the idle animations stop and he starts moving, but imagine if an AI could learn to adapt the idle animations to movement aswell... for example, the idle animation could be of the character taking off one of his boots and removing the sand from inside it and then putting it on, but if the player moves the character forward in the middle of it the AI could learn to make the character hop while trying to put the boot back on while moving forward...
I would troll the hell out of the AI.
That is a cool idea, but you also have to make sure that visual flair like that both cooperates with the gameplay and doesn't negatively affect the player experience. Let's say you implemented the sand-boot thing in a platformer game; when the player triggers it, you either have to let the player keep their normal speed and range of movement, leading to very awkward on-the-fly animations, or you have to impede the player's movement to make it more realistic, in which case the player's enjoyment is compromised.
@Honudes Gai That is such a bizarre opinion to have.
@@imveryangryitsnotbutter I don't think enjoyment has to be compromised. I could see a system where the player has to be mindful of controlling the character in such a way that they don't fall over. For example, running too fast down a steep slope, the character's feet will eventually get away from them and they'll fall on their face. Or running full pelt in one direction and sharply turning could cause the character to lose balance. I imagine it to be something like that realistic skateboarding game "Skate" where all this stuff is possible except there's no skateboard involved
Actually now I think of it, the GTA games have been doing this with the Euphoria motion engine thing and the results can be hilarious (jumping down stair cases, hanging onto car doors while they drive away etc)
Amazing! This movement will hopefully define a true "next gen" of games
Looking forward to NBA 2K29 when they finally update their game to include something like this!
Just a shame that they've moved on to simulating gambling experiences instead of basketball just as all this cool research is coming out.
@@shallowandpedantic2320 same as fifa they're just going where the money is 😔
@@shallowandpedantic2320 NBA2k19 did great for implementing mini GTA V in game it's just sad that there's no competition since NBA2K is far ahead than other basketball game
NBA3K1
that would be sick
NBA 2K could really use an improvement such as this to it's motor realism!
I wish but responsiveness would make it unplayable
@@onbggt4556 true, it would just be multiple modes of "let the human win" at varying degrees of difficulty. That's probably the case now though.
This channel is awesome, I love their content..
You are very kind. Thank you so much! 🙏
Holy crap this kept getting better and better, absolutely amazing!
This is a gem. Amazing video with the most professional approach I have seen from any TH-camr.
So incredible! Thank you for sharing, as always, Two Minute Papers! :)
This is my favourite paper currently. Can't wait till this is implemented into games
This is the best thing I've seen today. I love it. Thank you very much for sharing it.
This could be a huge step in lowering development cost, brilliant work.
Not only that but increasing the quality at the same time this looks way better than most mocap animations I've seen cause of the stitching
Forget about video games for a minute, imagine the possibilities when this is applied to robotic motion
That’s truly impressive! This will be useful for reviewing and improving after a game in real-life one day.
It's been a while since a paper blew my mind like this. I'm absolutely stunned by thinking of the possibilites. WHAT A TIME TO BE ALIVE!
This is amazing and I love it all.
That example footage was rather occult... I was expecting to see the twin pillars of jackim and boaz, a ladder, maybe a few pyramids, and a really pointy sun.
"Do you want to study computer science or become a professional basketballer?"
Yes
Professional computer basketball science.
Holly shit, generally most of the "AI" stuff I see online isn't that impressive, it's mostly closed down physics engines or just massive data sets spending hours on end generating a result, but this one is a combination of neither!
the shooting data was just mind blowing low, this is where "AI" shines with a limited amount of data and time..
it didn't take 100 hours to render that one shot from 100GB of raw data :D
I'm doubting if the papers have ever been two minutes at all, of that I am glad :)
wow!
so are you saying we are close to an age where games no longer require animation packages?
imagine games and movies animating based on characteristics in real time..
this is mind blowing - even though i am familiar with similar works, looking at these concepts come to life is just amazing.
amazing work!
Thank you a lot for your videos! Without you I would have no idea of this incredible technological developments.
You are very kind, thank you so much! Happy to hear you've been enjoying the series!
Imagine if the training data was bigger!!! Greate video man, you always make amazed! Good work.
Taking Deep Learning this semester for graduate school and excited to dive into these topics!
hey, the guy who could sit anywhere is back!
This is seriously so cool. This NEEDS to be progressed into video games at some point, this is INSANE.
I'll be working on implementing this in production for an upcoming 3d animation start-up 😋
Where can I sign up? 😁
@@AppReviewGerman reach out to 2Immersive4u on Facebook ✌️
I always get so excited when you say rhe words "2 more papers along the line" 😂
Man.... imagine combining this with physics based animation for games. It would be the ultimate realism!!!
I always felt that the biggest immersion breaker in video games is the uncanny character movements. I a can't wait to see these advancements being implemented in games very soon. What a time to be alive indeed
Using AI to sort through data structures is so amazing! Just look at the results 🤯
Haven't even watched the video i know its gonna be amazing! What a time to be alive! Much love from Hungary!
Two more papers down the line won't even be a research paper, but the EULA of an NBA game
Jó látni hogy eljutottak ilyen international szintre a magyarok, csak igy tovább!
This is amazing work!
That would be the coolest thing in basketball games, lot of the players individual personalities are lost in the animations, having players actually move and shoot like their real life counterparts with all their subtleties would be amazing. Michael Jordan reacting like Michael Jordan would in certain physical situation, its what made MJ who he was compared to a Scottie Pippen, or Shaquille Oneal , how they moved and acted, and this stuff here could totatly bring that for us, amazing!
These are the kind of things that years ago i didn't even dare to dream of... I'm anazed to see how well we are progressing~
Can’t wait to see Ai animals learn to maul, bite and hold onto characters like authentic animals.
One day we will just have all NBA players play a few games hooked up to motion capture and then every individual player will move, shoot, and make choices just like the actual player. This is so exciting.
Wow this is awesome!
Amazing work, the natural flow of the movements is amazing. Could you elaborate on the extent of data shortage? 6 minutes of shooting doesn’t seem like little to me, since a shot sequence would be about 3 seconds?
Wow this thing is insane can’t wait for this to be used in games.
amazing stuff! Keep it up
Wow this is really cool, you should also try this to simulate a football player dribbling the balls too
Loving it!
These videos are really inspiring. You got another subscriber. AI is the future.
This is direct animation controller not the physical based animation controller, you shouldn't compare it with work cause that is fully physical based controller
this video is GOLD!
This is incredible.
I love it! This could cut a lot of time and money for developers when it will be implemented in game engines
Animation looks way better than both NBA 2k and Live. It also has a clean animation transition which NBA 2k lacks. Great video.
I have no idea whats going on and how, but i LOVE it
Can't wait for the first 2k with those techniques
Dude we need this on a Ps4 or something, imagine how awesome that would be! Samr wit the hide and seek, its so fun to watch!
Very interesting. I wonder if you could mo-cap different player to have the character play in their style.
I also hope they do something similar for general team movement and during plays
I'm really excited to see how a system like this could be used to create extremely realistic active ragdolls. I've always dreamt of the day when active ragdolls would be so efficient that a game could use them exclusively, even when the characters are just walking around and doing stuff normally.
This paper could solve something for me. Loving it.
I love these AI stuff man... even though I don't understand how it was made.
Great Paper! Apart from animation, what kind of AI programming does EA use for its games? Especially when it comes to a simulation match (AI vAI) on NBA 2K or UFC 3 for example?
God this is so cool, it’s really going to change the gaming industry
Can't wait for that two papers down the line. We'll be living in an utopia by that time.
I was holding on to my papers! Amazing possibilities. I wonder if they are able to decode dophin language in the near future. AI is improving extremely fast.
Movement is 'obvious'; symbolic language is not as the meaning is arbitrary, working off at least two layers
@@seamusoblainn4603 That is true! I really hope AI could be used to communicate with certain animals in the future. But it is certainly huge and difficult task.
Beautiful.
The ball slides on the floor when the character mover fast!
Very nice moves here.
Someone should show the motion capture actors the proper way to lift up a box in order to protect the spine, so the AI can learn it too and we see in games a more healthy way of dealing with picking up boxes.
I'd love to know which games use these techniques, or at least which game publishers are looking into it or buying usage rights. Especially VR.
as i remember, For Honor uses AI generated animations, as well as The Last of Us Part 2 and some other games
new Unreal Engine 5 will have native tools for animation transitions similar to this, so, it's becoming quite popular in industry
Cant wait for this to be implemented in games
Waiting for the time when we see an AI MMA Championship.
My god, imagine actually interactive 1-on-1 fights that does not have to be prescripted
YES! Please make it comes true! That would be fkg awesome.
Could theoretically do this already in EA Sports UFC 3
If the AIs are as advanced as this, it'd probably be an extremely boring fight to most human observers.
In human MMA, most people like it when one guy makes a mistake, then gets punished for it. Equal AI fights would likely lead to ridiculously tactical battles, with very little "action."
@@Fermion. I'd like to see it used to make every fighter slightly different but realistically
I really recommend suggesting this to A-rated game developers. There's a demand for algorithms like this. Be it sports, fighting, RPG games. Looking forward more research like this.
I'd love to see that implemented in games, controling AI would be fascinating.
So those basketball games that've been the same game re-released since 2008 will finally have something new to add.
We need a game like this
This is absolutely incredible and terrifyingly close to what I wanted to achieve. Actually, I wanted an AI to learn how a certain player moves, so the AI can predict how the player performs any move and string it to any other move.
God you are such a brilliant man. What a great channel!
This paper would be really helpful to games with adventure genre games. Wonder if it would still look smooth on uneven ground?
This new technique is absolutely jaw-dropping, so excited for the future of gaming! That is if 2020 doesn't kill us first.......
I can't wait until this becomes mandatory in the animation process.
That kind of defeats the purpose,I do agree in the pipeline having this would speed things up especially for tricky scenes,but then it becomes "if we could have mimicked the human body this precisely why did we bother animating" .One of animations benefits is its limitations and watching those limitations be broken,but another un part of animation is actually making it.It remind me when directors are asked why they still use 35mm cameras and not just put a filter/overlay to create the effect and the answer is often "the limitaions force focus".Their has been a temphasisi in the years past that animation needs to et more realistic and so does its movement and all of that often excludes that animation can be more than just realsitic.so I just want to say we can have really detailed animation,but it does not need to be in every pipeline.
@@koketsok1513 I think he is referring to animation in the context of video games where realism is absolutely the prime objective (excluding non-realistic art styles of course). I don't think you need to worry about the artistry of animation going anywhere but in the use cases where you want realism above all else it unfortunately isn't possible to accomplish without motion capture and learning algorithm tools to stitch the mocap together.
@@TPF00T I think you are right.In terms of sport/physics based gaming realistic movement would e whats wanted and It could be a benefit to the piplene,but with how many companies like EA are nickle and dimming their player base I doubt they would introduce this.Perhaps as tech like this becomes cheaper to get companies will be held to a higher standard.
I’m interested in the team responsible for rendering the character physical properties. There appear to be some differences in musculature from character to character. Do these renderings contribute to the overall health/performance of the model? As in, does the skeletal character frame differ in a way which affects the model’s behavior? The white character appears to be proportionately represented, whereas the Black character appears to be rendered with the body of a power lifter and the head of a child. Representation is important, and going forward I wonder whether adequate consideration was afforded character design, especially in the context of a teaching tool.
There is another youtuber that reminds me of Two Minut paper, but he’s all about Healthcare and AI. Where he showcase the future of healthcare, medicine, etc.
I love Five Minute Papers!
Reminds me of good ol' Prince of Persia (the original game). The NON instant realistic movements is what made that game so good, but they removed that in later games for some reason. Here's hoping this could be used in an updated 2d version!
i just played the demo this thing is awesome
Where?
I was curious, can the research be implemented in the improvement of robot gaits in 4 or 2 legged robots ?
I didn't know Ren makes awesome tech videos!
If I understand this, they organise all the unstructured motion capture data according to what type of movement is involved, and then they just throw all of the bone locations at the AI along with some information on the "Local Motion Phase" and a few other variables, and they get out a new skeleton, new LMP, and updated variables.
But what does unstructured data actually mean?
Does it just mean they aren't linking the bones together or trying to impose physically based limits on the system? Or is there something else?
Wouldn't it be possible for these techniques, to be used to map the movements of robots? Like inverse kinematics to the robot joints position relative to each other and use this model to map the trajectory speeds and positions to make the robot move more natural with ease?
NBA players: We are professionals
AI: I’m just built different
in the future i can see a dedicated chip/card for handling AI, just like physics was a load on the cpu AI is probably the next thing that can be separated out to increase performance.
Those AIs are even better at me in playing basketball. lmao
Now implement that into Boston Robotics and you will have an basketball playing robot. :D
Hope they incorporate these into games 1 gen from now. In 2-3 years.
Simply Amazing,
But how do the basketball players handle boxes being hurled at their heads?
Would you please make full tutorial from beginning for beginners about motion capture for dance ?
how does one get started learning to do this ? like what software are they using for the modelling and what programming langage etc ?