@@oat1000 its fine, 2nd place isnt bad at all Though i dont really care if my character's moves are realistic; cool looks matter more in games. In real life and simulations though..m
In 20 Years there's gonna be a Martial Art developed by an AI called Cyber-Fu which is the most effective, physically possible way to defend yourself.😅
@@mushycookies6470 I don't walk around fearing being attacked, but if I did I'd be better off walking with friends, carrying a weapon, and avoiding places I felt were dangerous than learning martial arts. Martial arts aren't useless for self defense, but they usually aren't the best option. If someone really does jump you, martial arts are unlikely to help if you're stabbed or outnumbered.
imagine being a real life thai boxer (which is what this is) and play in vr with your movements being perfectly replicated. Instead of hitting the bag in your moms stinky basement when your adhd get too much you can go into vr instead.
@@adrianflo6481 Im a martial artists of 28yrs. I also enjoy fighting games. These things are two COMPLETELY different things. For one thing, you cant get any feedback in-game, when throwing a kick in VR. This means, for example, that your attacks will easily over-shoot the VR character.. because the Physical Persons body, is not actually there to stop the movement on Impact. If you try to stop the kick mid-air yourself... it will be and react, completely different. Then you have combinations, such as kicking the low leg, to the high head. Or planting your foot on the OPs hip, to leap up to the OPs shoulders. Without "purchase" of an actual physical body... these things cant be experienced / performed in VR. But more the the Actual point: A martial artists gets a completely different level of development and satisfaction, from martial arts training, and combat practice. I worked hardcore... and in maybe 5 months time.. I went from having a clumsy weak "dough-boy" body... to being fit, coordinated, and hard as Iron. That alone, gave me a Life Changing satisfaction, that no VR game can ever give someone. Continuing: I gradually built up real physical fighting skills, that when I fully mastered, was able to be performed flawlessly and effectively, in heavy impact sparring sessions.. typically against fighters 2x my own mass and strength. Being able to defend yourself properly, under adrenalized stress... is yet another high that no VR game can give a person. Its just not even close to being the same thing. Hell... just the act of sparring itself... produces a level of thrill and adrenalin, that cant be compared. Your very bodily life is actual on the line. If you screw up... you will easily suffer great pain, and likely some mild to severe injuries. If a VR model gets hit... you cant feel it. Even with Haptics, or mild physical shocks.. its not even close to the same effect. Then there is Live Feedback. This is even more relevant to combat. In the highest level combat... we relay on heavily on TOUCH instead of the EYES. Why? Because there is a processing delay between what your eyes detect... and the visual processing center of the brain. As a result.. its easy to make the hand move quicker then the eye can detect. By extending your arms further away from your body... you can use them to not only give you more space and time.. (keeping the OP further away) but also, to protect and divide the 3d space up. Then, if the OP attacks.. you can sweep the general area of the direction they are attacking. Once your arm intercepts theirs.. you will INSTANTLY know everything about their attack, based on FEEL... and so you can react to it accordingly, and correctly. For example.. I can throw a finger strike at your eyes, and just about fully retrace it, before you even realized I threw it. However... if a small insect lands on your arm.. you know exactly when it happened down to the millisecond. You know how big it is. How heavy. How much force it came in with. And you know the vector direction it was flying. You also will know if / when it changes is actions. If my arms is attached to yours... I can tell if you are putting more vectored energy towards the center of my body... or towards the side of my shoulders. I can also tell, if you try to change levels... from high to low gate... as you are still attacking. This allows me to formulate the best response, to be able to re-direct your arm and body, with almost zero effort. All within a "Fraction of a Second" worth of time. Again... you cant do that in VR. You cant feel the vector of an OPs arm and massed paths. Also realize... that because combat movements can happen in fraction of second timeframes... that you dont have time to "Think" about what to do. If a person throws a non-telegraphed jab... especially if its a counter-strike... the OP is typically Hit before realizing that attack was even thrown. In the best situation, of a telegraphed strike.. the OP might be able to roll with a strikes impact... such as rolling the head to the side, with the sideward hook, to reduce the impact potentials. All of this boils down to your very ignorance about the depth and complexity about actual combat... and your own laziness and personal issues with having a good work ethic, to achieve good results in physical challenges. Using the musty smell of a damp basement, is a crappy excuse. Its also a very easily solvable thing... by installing a simple dehumidifier, and putting air air ionizer down there. If the smells were extremely bad.. one could seal off and blast the area with an Ozone generator for a few hours, as that bleaches away all nasty scents. Once the room clears of the ozone... it will be fresh, clean, and smell-free (its how the repair smoke damages from house fires). Most of that smell is merely mildew, mold, and moisture, that can easily be cleaned up, and eliminated. As a person that didnt initially have a place to train, I trained anywhere and everywhere, that I could. For example... I put on hard leather bottomed dress shoes on, and heel+instep kicked a tree for about 1hr, in four 15 min sets. Each set was Nonstop kicking, full speed, full impact potentials. The foot stings with each impact. Heck... even if you didnt have a thick tree around... you can perform a similar method by either flat-footing a concrete wall (Ive done this as well), to a slightly lesser skill.. but at least to get the conditioning, you can stomping the concrete ground flat footed as well. Anyway... as much as I love video games... and would like to experience VR to a level beyond the limited phone demo crap... These things will never be even close to equal, without a radical feedback system. Im talking... the actual ability to physically Stop your swinging leg. Its actually possible... but the costs of such a device, will unlikely be realistic for typical consumers.
I'm sure if some One was crazy enough they could capture hundreds of hours of motion capture data of doing daily activities like making coffee and stuff and with all the physics and simulations getting real someone can make a realistic ass movie with just this AI and simulation stuff
Seems less like making it faster and more like making it the job of an AI. What is there to animate if you start with a skeleton and a skin and then apply the AI to get all the movement you need, pre-mapped to controller input?
Potentially I can see this system being able to contribute to Martial Arts knowledge in general. Finding out new techniques never done before based upon the framework of what we already know. Weeding out what doesn't work, and potentially changing how we see martial arts. This is an amazing step in my eyes.
@@אדרששון not now, but probably within our decade. The researchers will probably have to use more realistic models and physics to simulate real movements and damage, which definitely takes more processing power
@@lucasfranke5161 wow you can text someon?!??😲 do you know baki the grappler? 🙂 Do u think ai will change storytelling? i dont I do boxing in the back yard, its cool
The writer of Kengan Ashura already pointed out a problem with advanced level immigration. It doesn’t truly capture the attributes of the person who made the tactics work for them so something will always be off
Now let’s make physics-driven AI models with good kinematics and train them to beat the living daylights out of each other. Perfect VR boxing opponent!
Wow. You have really bad problems in life. Talk to other in real life, express your fellings ! It was a great attempt here and I en courage you to do so, but man. Internet is not life. Keep that in mind. 👍🤗
@@numero7mojeangering Wow. You have really bad problems in life, feeling the need to put people down must mean that nobody in your life likes you! Why don’t you try to talk to people, instead of picking fights on the internet. TH-cam is not life! 😊
@@planetdesign4681 I was not trying to pick fights ! Encourage people to not get discouraged ! Yes TH-cam can be life at a certain limits ! I'm sorry if it's how you get what I write 😸
Yeah my judgement is quite rude here and I'm sorry for that. Will try to not judge that much next time but was quite stressed because of the recent évènements of my life ! So your right in certain areas of the discussion ! 🤗👍
It's probably still far off, but I can imagine something like this being used to smooth out movements of virtual reality rigs. It would mean you don't have to map every point on the body to every point on your virtual body, yet still get realistic movements. Also, it could help someone who doesn't know how to fight be able to make realistic fighting moves in virtual reality games, for example.
Then, when we're finally able to funnel a lot of biometric data into game engines, game developers could start using your heart rate to make you faster in the moment and level of fatigue to make your character more sluggish over time.
How are we not already past that point? This paper is about an AI that does all of what you describe, client-side, in real time, isn't it? All you need to do is program a 20-bone skeleton, a skin, and train the AI on a couple hours of relevant video footage.
You read my mind 3 hours in advance! This would be awesome!! I can just imagine fighting an AI like this. Just think of the vr game Thrill of the Fight but even more realistic (hopefully with better graphics too lol)
@@aeryfirst4189 We need graphic artists and programmers with the skills of a year 1 college student, plus this AI. Also we need gamers with...two thumbs. Seems doable.
@@voidabstraction Many video games already utilize a relatively primitive technique for physics-based, procedural animation! Data like this would not be very difficult to implement into a more efficient engine "one or two papers down the line" ;-)
I love how smooth the interaction between the characters is. That's really amazing. Now I just need to see the transformation between seperated movement and interaction
A rough estimate for these things to start appearing in modern video games would be cool. We have had some oldschool attempts of dynamic motion in the past but this outstanding work would open a whole new world of immersion for all kinds of applications.
@@voidabstraction ive used root motion to create a vault in ue5 but nothing like this sort of freeform movement, could you explain a little more or give me some keywords to look into? And what is the snake at the foot of these IK rigs I keep seeing, is there a word for that?
@@Old299dfk My comment is in reference to that video. It seems you need further explanation, to slap the chicken until cooked, fast enough, is not humanly possible. I was saying that ai could invent a new way of moving the human body we hadn't thought of to generate the energy required to fullfil the videos goal.
I would love to see AI like this do gymnastics. Given some "realistic physics" it'd be interesting to see how it generates the momentum it needs. Position of arms, angle of take off, etc.
I'd really be interested in seeing this applied to Braziliion Jiu Jitsu considering it's very similar to a chess match. Imagine if AI could invent new submissions or sweeps. Incredible!
I've been waiting for something like this to be practically added to a game. I was watching a video about Dark Souls and the various attacks, and how starting an attack would "lock you in" to the full move, because it was "realistic" that you couldn't just shift one move into another like you can in many other games. But the actual realism is that if you start one move and then cancel into another, yes, it wouldn't just jump into that new animation, but you wouldn't be locked in either, it would just awkwardly shift the momentum of the first movement into the intentions of the second, which humans do many times per day, but when is hard when working with keyframed animations. But with AI animations, it can realistically smooth between one animation and another, taking, say, a heavy overhead strike, and converting it into a sideways strike, where all the weight and momentum of the first move is carried into the second, either improving it, or perhaps making it less effective, depending on when you made the change-over.
It would be amazing if the next GTA game implemented this into their game. If you for example wanted to kick an enemy, all kicks would be slightly different, making the fight more dynamic. Also generating combos that are true to the original move, but always behaves slightly different.
Gta 4 had it with reactive punching, kicking, dodging but San Andreas had it with the different fighting styles like boxing, kickboxing, and karate. Gta 6 should improve on the fighting mechanics and have multiple fighting styles.
if we can substitute various kinds of non-violent behaviour for the boxing and use the controller for those actions, that might already be good enough for background characters and a step closer for foreground characters (in films). progress on the dreaded foot-sliding looks pretty good, too.
@@numero7mojeangering the realtime part is very interesting for making characters move differently and apparently more as they would in real life. if one had a lot of background characters in a scene it would probably still be better to have the AI work out the movements and interactions autonomously.
3:06 That wouldn't work, the motion to one side needs a wave to go back to the other side. attack movement cannot have force in such a situation in real life. But, the work is very promising, it's really good to have an opponent where you can test lethal moves, because sparring u don't want to hurt your opponent, plus you both are getting better and if you're hurt you can't practice and reach that point (obviously). So this has very real implication for better training, whether soldiers, police or martial arts enthusiasts.
Then Kengan Ashura shits. (The premise of the show is that companies settle their disputes by hiring champions to fight in an underground MMA or some shit.)
I got interested in AI 16yrs ago, after watching Street Fighter Alpha animated movie in which they made an AI learn from Street Fighter's fighting data and made a robot better than all of them. I was into martial arts, sci-fi, physics and creative stuff. I'm pursuing AI ever since and worked on similar Game AI, Vision and RL ideas too.
If anybody has studied the choreography in a movie called upgrade it shows that an AI wouldn't choose to move in a way that looks like any form of martial arts. It would use the most efficient method possible and being constantly aware of variables yet to occur very much like a chess master. Don't hold me to that it's just an opinion.
interesting.. for a video game you could use the AI but impair the fighter in certain ways. For example, make him kick less effectively with his left than his right, make him sometimes lose his balance, etc.. That way you could have different fighters. Same training but different capabilities.
A polished version of this and I could see trainers using it for their fighters. Could you imagine breaking down all of your competition with AI and using it to come up with strategies for a fighter's competition? Has a lot of potential will become more amazing than it already is.
35 years ago I was a 3rd Dan TaeKwonDo teacher and software developer, and I was trying to use Direct 3D in C++ to develop a database of techniques and forms for students. I actually wanted to hook it up to a hardware 'trainer/sparring partner' and formed the Australian Fighting Machine Company. I didn't get far because Microsoft dropped Direct 3D, and I found Immediate mode 3D too hard. Life got in the way and now I'm 70. This paper blew my mind. It would be so easy to setup what I was dreaming up (and much more) using this methodology.
the result at 3:12 doesn't work bc dodging with your momentum traveling in the opposite direction as the punch reduces its effectiveness a lot. you'll need to add in physics/effectiveness factors as an optimization constraint where motions that are in sync with body momentum produce greater force than ones that are contra-momentum.
It still looks like a video game character instead of a pro fighter. The difference: flexibility. The fighter looks like a boxer trying to do kicks. Make the AI super flexible and the AI will likely adapt to a professional style, since it means longer reach and thus more effective fighting.
Let's take a moment to hold on to our papers and revel at the amazing moves the AI strung together. Marvelous sight to be seen! What a time to be alive...
Very cool. The controlling aspect is a problem with many martial arts games, as due to controller limitations it is difficult to control all the movement required. Example: controlling the upper body with analog and the lower body simultaneously, while still having access to the main face buttons. It can be done despite it being not ergonomic by those who practice or developed methods to do so. The tetris controller method is a good example. Lol
You'd get a smack in the head if you slipped a cross and had your right hand down. Plus the AI figure throws his left hook, after the slip, but without any momentum. It's basically a flick. He's not using any power. It looks cool but it's very far from real combat.
I hope this moment mark the birth of the Future of AI athletes, where we can see sport events only for AI, they all have same physical attributes but each trained with different paper, may the best paper win
I think for it to be even more effective you’d have to program in characters mass, friction against the floor and give the overall goal of causing maximum g-force to the opponents body (with bias towards to the head)
Amazing. Extremely impressed. Noticed a real prob @ 2:50 however. You cannot move your head offline while striking in the opposite direction. The weight shift is completely backwards. You'll be terribly off balance & have absolutely no power. You have to strike w/ the opposite arm in the direction you're shifting your weight in that case. You simply won't see this sequence IRL. Great work though otherwise ! Edit: To make it accurate, the lean off line must be accompanied by an adjustment in stance & a step in the direction you're leaning. They just can't be laterally top heavy. And in that case a bodyshot or an uppercut is much more likely. You'll never see a lean left accompanied by a lead left hook to the head.
It would be amazing to have these in VR fighting simulators and test every mind of strategy and technics, imagine how good fighters could become fighting with those
I hope we will be able to see some new fighting games that utilize these techniques. Köszönjük Tanár úr, mint mindíg, érdekes és jó a videó prezentáció!
at 1:08 showing the disconnected movement of throwing an overhand right / wide right hook, slipping left while walking in on centerline isn't an incorrect fighting tactic. the third example at 1:20 of foot sliding artifacts shows a tactic UFC Champ Dominick Cruz uses, a fighter starting from a left lead, utilizing a switch step stance to a right lead at a 45 degree angle to the right while slipping right, then throwing a right upper cut and left hook while switch stepping back to left lead.
I've only just begun my journey in gamedev using unreal engine. All this stuff is so amazing and watching this video made me think, imagine what moves the ai would invent for stealth games if you programmed a few stealth kills and actions. Would be interesting to see how ai would invent takedown methods. Could even get imaginative and see what it will come up with when adding special abilities like dodging bullets matrix style. What inventive ways will it come up with for superhero landings, wallrunning and parkour!! Damn!! I want one!!!
thank you for all your amazing work and inspiration. I started doing AI watching your channel, one year in the field now (even if only amateur) and perecptilabs its helping me a lot with my graphic novel! So much fresh and innovative! Love it! Thank you!!
The motions are quite superb, but as any fighter will tell you, you do not rotate on that much or place your weight on the heels. Most of the weight will be on the front of the foot, allowing for mobility and impact resistance.
For years, we've had too many foot-sliding in games. I remember when PS3 about to come out, they demonstrated that foot-planting would replace character foot-sliding but never materialized. I hop this bring the change we need.
thrilled for the next step of this where you can instruct the AI on having stylized elements so that we can get prodecural real time wire fu and anime duels, or a fighting game where the developer can set time guarantees on certain moves for balance reasons and tweak a variable saying how much they're willing to compromise on realism to make each move happen
Some movements/actions are good only in theory but in most cases, regarding defenses and counter-attacks (2:45), keeping the other side of your body rigid will result in a reduction of the torsion of your body and the potential force you can generate by it, making the attack feel more like a friendly jab then an actual full-force attack. Some of these are better revised to fit more realistic elements of biomechanics. Another way to put it into words is quoting the first principle of Wing Chun "Free yourself from your onw force" (which in this case would be the aforementioned "tension").
I hope that this will make designing 3D games a more accessible venture for indie devs going into the future. Being able to achieve realistic movement of a character without being a modeling/animation expert would surely make creating a 3D game a much less daunting idea. It would require someone to create and upload a royalty free software implementation that people can copy, but hopefully someone will feel generous enough to do the work…
I could see a cool as game where people scan themselves irl whilst doing martial arts and the ai then gets trained on them after witch people Duke it out with their characters using controllers
all of this could be used in a VR game where you fight hand to hand or with a hand to hand weapon (swords, axes, spears, etc.). The AI would perform moves and counter moves with original patterns and with the aim of regulating the difficulty of the game itself.
pretty interesting... the only thing that's missing is trying to maximize the momentum behind attacks... right now it seems to be mainly using the immediate local muscles to move the limb, rather than adding the whole body's weight to extend through the attack
One step closer to robot gladiators who can showcase optimal human combat unlike anything we've seen before. Now that will be the pinnacle of spectator sports.
I wonder if we can build upon that to try to improve more efficent human close-quarter combate if is provided with enough material of a variety of martial arts moves, reactions and counters.
that counter attack @ 3:00 isnt really a solid counter punch i wonder if introducing force in to the physics will improve the novel animations created by finding the optimal punch / kick after a specific dodge
Finally, my boston dynamics robots will test how good humans are at standing
"I now hold the stick... *And I hold it better than you ever did."*
Oh how the turntables
Underrated comment
Atlas: Who's kicking who now?!
@@oat1000 its fine, 2nd place isnt bad at all
Though i dont really care if my character's moves are realistic; cool looks matter more in games. In real life and simulations though..m
In 20 Years there's gonna be a Martial Art developed by an AI called Cyber-Fu which is the most effective, physically possible way to defend yourself.😅
Then you will download them unto your central nervous system and know cyber-fu.
@@tuseroni6085 Cool, I'll be a 62 Years old Cyber Fu Grandmaster ! 💪🧓🤜
And it's just "don't go somewhere where you'll get attacked"
@@wafflescripter9051 What do you mean ? Outside the House ? No, I'm staying Home in fear.
@@mushycookies6470 I don't walk around fearing being attacked, but if I did I'd be better off walking with friends, carrying a weapon, and avoiding places I felt were dangerous than learning martial arts.
Martial arts aren't useless for self defense, but they usually aren't the best option. If someone really does jump you, martial arts are unlikely to help if you're stabbed or outnumbered.
Being able to control a realistic AI boxer in a multiplayer game would be so fun
First 30 minutes bruh
Or animation and anime fight scenes, would be amazing
imagine being a real life thai boxer (which is what this is) and play in vr with your movements being perfectly replicated. Instead of hitting the bag in your moms stinky basement when your adhd get too much you can go into vr instead.
I have dreamed a long time of making AI's copy real boxers and. From film analysis. Then have them to fight eachother. Tyson vs Ali etc..
@@adrianflo6481 Im a martial artists of 28yrs. I also enjoy fighting games. These things are two COMPLETELY different things. For one thing, you cant get any feedback in-game, when throwing a kick in VR. This means, for example, that your attacks will easily over-shoot the VR character.. because the Physical Persons body, is not actually there to stop the movement on Impact. If you try to stop the kick mid-air yourself... it will be and react, completely different.
Then you have combinations, such as kicking the low leg, to the high head. Or planting your foot on the OPs hip, to leap up to the OPs shoulders. Without "purchase" of an actual physical body... these things cant be experienced / performed in VR.
But more the the Actual point: A martial artists gets a completely different level of development and satisfaction, from martial arts training, and combat practice. I worked hardcore... and in maybe 5 months time.. I went from having a clumsy weak "dough-boy" body... to being fit, coordinated, and hard as Iron. That alone, gave me a Life Changing satisfaction, that no VR game can ever give someone.
Continuing: I gradually built up real physical fighting skills, that when I fully mastered, was able to be performed flawlessly and effectively, in heavy impact sparring sessions.. typically against fighters 2x my own mass and strength. Being able to defend yourself properly, under adrenalized stress... is yet another high that no VR game can give a person. Its just not even close to being the same thing.
Hell... just the act of sparring itself... produces a level of thrill and adrenalin, that cant be compared. Your very bodily life is actual on the line. If you screw up... you will easily suffer great pain, and likely some mild to severe injuries. If a VR model gets hit... you cant feel it. Even with Haptics, or mild physical shocks.. its not even close to the same effect.
Then there is Live Feedback. This is even more relevant to combat. In the highest level combat... we relay on heavily on TOUCH instead of the EYES. Why? Because there is a processing delay between what your eyes detect... and the visual processing center of the brain. As a result.. its easy to make the hand move quicker then the eye can detect. By extending your arms further away from your body... you can use them to not only give you more space and time.. (keeping the OP further away) but also, to protect and divide the 3d space up. Then, if the OP attacks.. you can sweep the general area of the direction they are attacking. Once your arm intercepts theirs.. you will INSTANTLY know everything about their attack, based on FEEL... and so you can react to it accordingly, and correctly.
For example.. I can throw a finger strike at your eyes, and just about fully retrace it, before you even realized I threw it. However... if a small insect lands on your arm.. you know exactly when it happened down to the millisecond. You know how big it is. How heavy. How much force it came in with. And you know the vector direction it was flying. You also will know if / when it changes is actions. If my arms is attached to yours... I can tell if you are putting more vectored energy towards the center of my body... or towards the side of my shoulders. I can also tell, if you try to change levels... from high to low gate... as you are still attacking. This allows me to formulate the best response, to be able to re-direct your arm and body, with almost zero effort. All within a "Fraction of a Second" worth of time.
Again... you cant do that in VR. You cant feel the vector of an OPs arm and massed paths.
Also realize... that because combat movements can happen in fraction of second timeframes... that you dont have time to "Think" about what to do. If a person throws a non-telegraphed jab... especially if its a counter-strike... the OP is typically Hit before realizing that attack was even thrown. In the best situation, of a telegraphed strike.. the OP might be able to roll with a strikes impact... such as rolling the head to the side, with the sideward hook, to reduce the impact potentials.
All of this boils down to your very ignorance about the depth and complexity about actual combat... and your own laziness and personal issues with having a good work ethic, to achieve good results in physical challenges.
Using the musty smell of a damp basement, is a crappy excuse. Its also a very easily solvable thing... by installing a simple dehumidifier, and putting air air ionizer down there. If the smells were extremely bad.. one could seal off and blast the area with an Ozone generator for a few hours, as that bleaches away all nasty scents. Once the room clears of the ozone... it will be fresh, clean, and smell-free (its how the repair smoke damages from house fires). Most of that smell is merely mildew, mold, and moisture, that can easily be cleaned up, and eliminated.
As a person that didnt initially have a place to train, I trained anywhere and everywhere, that I could. For example... I put on hard leather bottomed dress shoes on, and heel+instep kicked a tree for about 1hr, in four 15 min sets. Each set was Nonstop kicking, full speed, full impact potentials. The foot stings with each impact. Heck... even if you didnt have a thick tree around... you can perform a similar method by either flat-footing a concrete wall (Ive done this as well), to a slightly lesser skill.. but at least to get the conditioning, you can stomping the concrete ground flat footed as well.
Anyway... as much as I love video games... and would like to experience VR to a level beyond the limited phone demo crap... These things will never be even close to equal, without a radical feedback system. Im talking... the actual ability to physically Stop your swinging leg. Its actually possible... but the costs of such a device, will unlikely be realistic for typical consumers.
As an Animator I'm very excited to see this, Animating with AI assistant will be soo much faster
I'm sure if some One was crazy enough they could capture hundreds of hours of motion capture data of doing daily activities like making coffee and stuff and with all the physics and simulations getting real someone can make a realistic ass movie with just this AI and simulation stuff
Let's say you have a boxing movie and the boxers are just two people playing this with the metahumans from unreal
Faster? I don't think that's the right word here. This would finally be something worthy of actually being called "animation".
Seems less like making it faster and more like making it the job of an AI. What is there to animate if you start with a skeleton and a skin and then apply the AI to get all the movement you need, pre-mapped to controller input?
@@ChinoxBoi Not exactly from unreal, but I'm pretty sure there's a movie of that but with actual robots.
Potentially I can see this system being able to contribute to Martial Arts knowledge in general. Finding out new techniques never done before based upon the framework of what we already know. Weeding out what doesn't work, and potentially changing how we see martial arts.
This is an amazing step in my eyes.
i dont know man it dosent look vary good at all now
thay would have to acount to a lot of things
@@אדרששון not now, but probably within our decade. The researchers will probably have to use more realistic models and physics to simulate real movements and damage, which definitely takes more processing power
@@lucasfranke5161 wow you can text someon?!??😲
do you know baki the grappler? 🙂
Do u think ai will change storytelling? i dont
I do boxing in the back yard, its cool
@@אדרששון
Your name probably fucked up TH-cam's formatting
The writer of Kengan Ashura already pointed out a problem with advanced level immigration. It doesn’t truly capture the attributes of the person who made the tactics work for them so something will always be off
Now let’s make physics-driven AI models with good kinematics and train them to beat the living daylights out of each other. Perfect VR boxing opponent!
VR? Load it into an Atlas robot, and get a real boxing partner.
Wow. You have really bad problems in life. Talk to other in real life, express your fellings ! It was a great attempt here and I en courage you to do so, but man. Internet is not life. Keep that in mind. 👍🤗
@@numero7mojeangering Wow. You have really bad problems in life, feeling the need to put people down must mean that nobody in your life likes you! Why don’t you try to talk to people, instead of picking fights on the internet. TH-cam is not life! 😊
@@planetdesign4681 I was not trying to pick fights ! Encourage people to not get discouraged ! Yes TH-cam can be life at a certain limits ! I'm sorry if it's how you get what I write 😸
Yeah my judgement is quite rude here and I'm sorry for that. Will try to not judge that much next time but was quite stressed because of the recent évènements of my life ! So your right in certain areas of the discussion ! 🤗👍
It's probably still far off, but I can imagine something like this being used to smooth out movements of virtual reality rigs. It would mean you don't have to map every point on the body to every point on your virtual body, yet still get realistic movements. Also, it could help someone who doesn't know how to fight be able to make realistic fighting moves in virtual reality games, for example.
Then, when we're finally able to funnel a lot of biometric data into game engines, game developers could start using your heart rate to make you faster in the moment and level of fatigue to make your character more sluggish over time.
How are we not already past that point? This paper is about an AI that does all of what you describe, client-side, in real time, isn't it? All you need to do is program a 20-bone skeleton, a skin, and train the AI on a couple hours of relevant video footage.
@@michaelleue7594 we need gamers with phd
You read my mind 3 hours in advance! This would be awesome!!
I can just imagine fighting an AI like this. Just think of the vr game Thrill of the Fight but even more realistic (hopefully with better graphics too lol)
@@aeryfirst4189 We need graphic artists and programmers with the skills of a year 1 college student, plus this AI. Also we need gamers with...two thumbs. Seems doable.
The future of fighting games is now VERY promising!!
You love fighting games like me ! 😜👍 (Literally)
@protec & attac Fire in the shape of a ball 🏀🔥 realisticality created with psychic energy from you hand
Yes and this also means some games in works would be delayed for some time to implement this.
You're confusing the appearance of animations with game mechanics. They are two completely different things.
@@voidabstraction
Many video games already utilize a relatively primitive technique for physics-based, procedural animation!
Data like this would not be very difficult to implement into a more efficient engine "one or two papers down the line" ;-)
I love how smooth the interaction between the characters is. That's really amazing. Now I just need to see the transformation between seperated movement and interaction
A rough estimate for these things to start appearing in modern video games would be cool. We have had some oldschool attempts of dynamic motion in the past but this outstanding work would open a whole new world of immersion for all kinds of applications.
A very basic version of this is already in UE5 with adaptive root motion.
2years would be the fastest
@@voidabstraction ive used root motion to create a vault in ue5 but nothing like this sort of freeform movement, could you explain a little more or give me some keywords to look into? And what is the snake at the foot of these IK rigs I keep seeing, is there a word for that?
2021 : It would make fights more realistic.
20XX hold on my papers: you can feel those punches and get kicked.
20XX is 2021, too!
@@NicolaiWeitkemper Great 👍 an optimistic person ! Continue to encourage people around you 😜
Don't be jealous of what I said to Nicolais
20XX: Or you can ask for a brother/sister. pretty much the same
@@johmbon 😂
2045: Scientists using AI have figured out a martial arts technique to cook chicken
😆😆
Simulate how many punches it takes to cook a chicken
@@vgtgoat 69
this has already been done... you just need to slap it.
video is on youtube somewhere
@@Old299dfk My comment is in reference to that video.
It seems you need further explanation, to slap the chicken until cooked, fast enough, is not humanly possible.
I was saying that ai could invent a new way of moving the human body we hadn't thought of to generate the energy required to fullfil the videos goal.
Step 1: hold on to your papers
Step 2: if step 1 performed, now squeeze
I died laughing.
You must be new here, if Dr Zsolnai-Feher has a well known catchphrase, that'd pretty much be it.
Some day I'd like to see an AI come up with its own martial art, and see how it compares to current ones.
I would love to see AI like this do gymnastics. Given some "realistic physics" it'd be interesting to see how it generates the momentum it needs. Position of arms, angle of take off, etc.
I'd really be interested in seeing this applied to Braziliion Jiu Jitsu considering it's very similar to a chess match. Imagine if AI could invent new submissions or sweeps. Incredible!
Honestly so many software and AI guys are into BJJ that I think this is feasible
It’s literally human chess, imagine the possibilities
probably not any new submissions, but definetly new setups for those and some novel strategies, as it does in actual chess
@@Chris_Preese i don’t see any knights or bishops in bjj matches you are lying
@@jooot_6850 i personally train with a royal englishman and a horse, so you're wrong
How does a human beat an android that has the exact same knowledge/skill base? I have a theory...
Unplug the grid. That is how
Hit harder
Pee on it.
"You just have to hit really hard"
By peeing and vomiting on it if it isnt waterproof
I've been waiting for something like this to be practically added to a game. I was watching a video about Dark Souls and the various attacks, and how starting an attack would "lock you in" to the full move, because it was "realistic" that you couldn't just shift one move into another like you can in many other games. But the actual realism is that if you start one move and then cancel into another, yes, it wouldn't just jump into that new animation, but you wouldn't be locked in either, it would just awkwardly shift the momentum of the first movement into the intentions of the second, which humans do many times per day, but when is hard when working with keyframed animations. But with AI animations, it can realistically smooth between one animation and another, taking, say, a heavy overhead strike, and converting it into a sideways strike, where all the weight and momentum of the first move is carried into the second, either improving it, or perhaps making it less effective, depending on when you made the change-over.
It would be amazing if the next GTA game implemented this into their game.
If you for example wanted to kick an enemy, all kicks would be slightly different, making the fight more dynamic.
Also generating combos that are true to the original move, but always behaves slightly different.
@BigBoyPeter Haha true, the ragdoll when being hit out of balance was pretty fun in gta 4.
Gta 5 was too static, both vehicles and characters.
Given that Rockstar have about another 10-20 years of milking GTA V yet, it could happen!
@OneTech but the GTA 4 fighting sucks. People act like it’s super dynamic, but it’s really stiff
How to not only explode your computer but quadruple development time lmao
Gta 4 had it with reactive punching, kicking, dodging but San Andreas had it with the different fighting styles like boxing, kickboxing, and karate.
Gta 6 should improve on the fighting mechanics and have multiple fighting styles.
That foot sliding artifact is what real humans do. In a slippery gym or in a street fight you see this
after two more papers down the line implement this in a game, and I'd love to play it
Honestly the reason why i watch this channel so often is to see the tech games will be using in 5 years lol.
if we can substitute various kinds of non-violent behaviour for the boxing and use the controller for those actions, that might already be good enough for background characters and a step closer for foreground characters (in films). progress on the dreaded foot-sliding looks pretty good, too.
That's true. But I think we can already do that. The thing that was missing was active realtime self active response and it's is day passed !
Yeah I invented some terms, it's my daily life
@@numero7mojeangering the realtime part is very interesting for making characters move differently and apparently more as they would in real life. if one had a lot of background characters in a scene it would probably still be better to have the AI work out the movements and interactions autonomously.
@@juliandarley yes absolutely
3:06 That wouldn't work, the motion to one side needs a wave to go back to the other side. attack movement cannot have force in such a situation in real life. But, the work is very promising, it's really good to have an opponent where you can test lethal moves, because sparring u don't want to hurt your opponent, plus you both are getting better and if you're hurt you can't practice and reach that point (obviously). So this has very real implication for better training, whether soldiers, police or martial arts enthusiasts.
Imagine having an AI coach as an mma fighter that analyzes your opponents' fights and trains you accordingly.
This would be outstanding for immersion in hunting games, god technology is the best.
Can’t wait for AIFC, coding companies fighting with their developed AI fighters
Then Kengan Ashura shits. (The premise of the show is that companies settle their disputes by hiring champions to fight in an underground MMA or some shit.)
I got interested in AI 16yrs ago, after watching Street Fighter Alpha animated movie in which they made an AI learn from Street Fighter's fighting data and made a robot better than all of them. I was into martial arts, sci-fi, physics and creative stuff. I'm pursuing AI ever since and worked on similar Game AI, Vision and RL ideas too.
If anybody has studied the choreography in a movie called upgrade it shows that an AI wouldn't choose to move in a way that looks like any form of martial arts. It would use the most efficient method possible and being constantly aware of variables yet to occur very much like a chess master. Don't hold me to that it's just an opinion.
Just the fact that it can iterate the most efficient moves it's going to teach us how to become the perfect fighters.
interesting.. for a video game you could use the AI but impair the fighter in certain ways. For example, make him kick less effectively with his left than his right, make him sometimes lose his balance, etc.. That way you could have different fighters. Same training but different capabilities.
@@dikdik969 no silly, I meant like make his left leg slower than his right. Or less flexible.. etc.. as a real person would be.
I would like to see the next assassins creed using something like this in their parkour stuff.
I remember losing a tournament with those combos
This looks very good. The future of animation is looking very good !
A polished version of this and I could see trainers using it for their fighters. Could you imagine breaking down all of your competition with AI and using it to come up with strategies for a fighter's competition? Has a lot of potential will become more amazing than it already is.
The foot sliding "artifacts" are a new move the AI created in MMA. It's called "moonwalking."
This is not just for fighting games, I train and the moves it comes up with can help fighters in many ways!
Imagine watching an AI fight
Watching live stream of ai fight on twitch/TH-cam
I just did?
Just watch Tyron Woodley
35 years ago I was a 3rd Dan TaeKwonDo teacher and software developer, and I was trying to use Direct 3D in C++ to develop a database of techniques and forms for students. I actually wanted to hook it up to a hardware 'trainer/sparring partner' and formed the Australian Fighting Machine Company. I didn't get far because Microsoft dropped Direct 3D, and I found Immediate mode 3D too hard. Life got in the way and now I'm 70. This paper blew my mind. It would be so easy to setup what I was dreaming up (and much more) using this methodology.
it looks pretty funky
the result at 3:12 doesn't work bc dodging with your momentum traveling in the opposite direction as the punch reduces its effectiveness a lot. you'll need to add in physics/effectiveness factors as an optimization constraint where motions that are in sync with body momentum produce greater force than ones that are contra-momentum.
combine this with the evolutionary boxers from that other paper and then we'll have something to really deathgrip our papers for.
Thank you - beautiful. The spinning backfist (et. al.) looked pretty realistic. Amazing
Teaching AI to more efficiently eliminate the human race is a brilliant idea lol.
Tay +these skills = Armageddon
Brilliant? They do not gaf about human unlike humans...all humanity is useless once AI controls everything
AI gladiator games anyone? As long as we don't let it leak into a physical robot everything should be fine.
poison gas? radiation? this is all way over engineered to kill.
Boxing is not an effective method for doing that.
It still looks like a video game character instead of a pro fighter. The difference: flexibility. The fighter looks like a boxer trying to do kicks. Make the AI super flexible and the AI will likely adapt to a professional style, since it means longer reach and thus more effective fighting.
Yes, teaching machines how to exterminate humans is a good idea.
Best comment here bro
The narrator sounds like a cool uncle presenting a cool toy to his nieces and nephews. Also, the voice is hypnotising.
Let's take a moment to hold on to our papers and revel at the amazing moves the AI strung together. Marvelous sight to be seen! What a time to be alive...
Yes. The last 10 years of humanity are awesome.
You just threw in the clinching at the end. WOW! That's impressive
I want to see someone run this type of ai on an already existing game like tekken see what kind of crazy tech it can come up with
Very cool. The controlling aspect is a problem with many martial arts games, as due to controller limitations it is difficult to control all the movement required. Example: controlling the upper body with analog and the lower body simultaneously, while still having access to the main face buttons. It can be done despite it being not ergonomic by those who practice or developed methods to do so. The tetris controller method is a good example. Lol
"Everyone has a plan until they get punched in the face." Tyson
That first "invented signature move" is a common move in both wushu and taekwondo afaik. But good AI, good AI *pat pat*
khabib would beat ai
They need to use this ai system for 2k. It would make the game so much better along with its stunning graphics
I wanna see ai generated epic anime fights
Watch Kengan, it's not AI generated. But the fight choreography is epic. I'd say the best in anime.
Man the implementations of all of the recent papers in future video games is gonna be next level.
OMG i was waiting a fighting paper one! Thanks you!!
If I slipped and countered like that, my trainer would laugh at me. Still some way to go but man, most impressive.
Thank you. All these armchair “martial artists” in the comments don’t know the difference between theory and practice
You'd get a smack in the head if you slipped a cross and had your right hand down. Plus the AI figure throws his left hook, after the slip, but without any momentum. It's basically a flick. He's not using any power. It looks cool but it's very far from real combat.
I hope this moment mark the birth of the Future of AI athletes, where we can see sport events only for AI, they all have same physical attributes but each trained with different paper, may the best paper win
thatd be sick
As a fighter myself, I have to say, the AI’s form on some of those punches where better than my own!
the counter attack in 3:04 should be with right punch , but Amazing Video and amazing progress!
I think for it to be even more effective you’d have to program in characters mass, friction against the floor and give the overall goal of causing maximum g-force to the opponents body (with bias towards to the head)
3:17 I squeezed my papers as hard as I could and still can't handle how awesome that is
This will soon be like the Javis analysis on Captain America fight pattern in Civil War and come up with counter measures. Holy @#$!
as a martial artist who uses mocap i find this fascinating
please add this to every NPC in every game, thank you.
2:15 The spinning back fist !
*A UFC favorite*
Amazing. Extremely impressed. Noticed a real prob @ 2:50 however. You cannot move your head offline while striking in the opposite direction. The weight shift is completely backwards. You'll be terribly off balance & have absolutely no power. You have to strike w/ the opposite arm in the direction you're shifting your weight in that case. You simply won't see this sequence IRL. Great work though otherwise !
Edit: To make it accurate, the lean off line must be accompanied by an adjustment in stance & a step in the direction you're leaning. They just can't be laterally top heavy. And in that case a bodyshot or an uppercut is much more likely. You'll never see a lean left accompanied by a lead left hook to the head.
I want to see more of Anubis decorating his flat.
It would be amazing to have these in VR fighting simulators and test every mind of strategy and technics, imagine how good fighters could become fighting with those
I hope we will be able to see some new fighting games that utilize these techniques.
Köszönjük Tanár úr, mint mindíg, érdekes és jó a videó prezentáció!
at 1:08 showing the disconnected movement of throwing an overhand right / wide right hook, slipping left while walking in on centerline isn't an incorrect fighting tactic.
the third example at 1:20 of foot sliding artifacts shows a tactic UFC Champ Dominick Cruz uses, a fighter starting from a left lead, utilizing a switch step stance to a right lead at a 45 degree angle to the right while slipping right, then throwing a right upper cut and left hook while switch stepping back to left lead.
whoever programmed these movements did an absolutely incredible job
I've only just begun my journey in gamedev using unreal engine. All this stuff is so amazing and watching this video made me think, imagine what moves the ai would invent for stealth games if you programmed a few stealth kills and actions. Would be interesting to see how ai would invent takedown methods. Could even get imaginative and see what it will come up with when adding special abilities like dodging bullets matrix style. What inventive ways will it come up with for superhero landings, wallrunning and parkour!! Damn!! I want one!!!
Getting the kinesiology and physics right in the model is the most important step before expecting an AI to teach people how to move.
thank you for all your amazing work and inspiration. I started doing AI watching your channel, one year in the field now (even if only amateur) and perecptilabs its helping me a lot with my graphic novel! So much fresh and innovative! Love it! Thank you!!
The motions are quite superb, but as any fighter will tell you, you do not rotate on that much or place your weight on the heels. Most of the weight will be on the front of the foot, allowing for mobility and impact resistance.
For years, we've had too many foot-sliding in games. I remember when PS3 about to come out, they demonstrated that foot-planting would replace character foot-sliding but never materialized. I hop this bring the change we need.
Imagine a ufc game made from this
thrilled for the next step of this where you can instruct the AI on having stylized elements so that we can get prodecural real time wire fu and anime duels, or a fighting game where the developer can set time guarantees on certain moves for balance reasons and tweak a variable saying how much they're willing to compromise on realism to make each move happen
Flying spin kick from boxing league lol
NO WAAAAAY.
I've been wanting someone to do this to see the perfect mma fight.
Sliding foot happens because theres no friction from feets to the ground
Some movements/actions are good only in theory but in most cases, regarding defenses and counter-attacks (2:45), keeping the other side of your body rigid will result in a reduction of the torsion of your body and the potential force you can generate by it, making the attack feel more like a friendly jab then an actual full-force attack. Some of these are better revised to fit more realistic elements of biomechanics.
Another way to put it into words is quoting the first principle of Wing Chun "Free yourself from your onw force" (which in this case would be the aforementioned "tension").
I hope that this will make designing 3D games a more accessible venture for indie devs going into the future. Being able to achieve realistic movement of a character without being a modeling/animation expert would surely make creating a 3D game a much less daunting idea. It would require someone to create and upload a royalty free software implementation that people can copy, but hopefully someone will feel generous enough to do the work…
I'll be honest, I didn't expect our robot overlords to be Muay Thai experts.
I could see a cool as game where people scan themselves irl whilst doing martial arts and the ai then gets trained on them after witch people Duke it out with their characters using controllers
Imagine combinig this and boston dinamics robots
Imagine if fire suddenly learned how to make itself.
Your mind is gonna be blown when you find out about lightning 🌩️🤯
The smoothness of that animation is mine blowing.
all of this could be used in a VR game where you fight hand to hand or with a hand to hand weapon (swords, axes, spears, etc.).
The AI would perform moves and counter moves with original patterns and with the aim of regulating the difficulty of the game itself.
How am I supposed to move the right stick and press a button at the same time??
pretty interesting... the only thing that's missing is trying to maximize the momentum behind attacks... right now it seems to be mainly using the immediate local muscles to move the limb, rather than adding the whole body's weight to extend through the attack
Amazing coverage on the siggraph paper
One step closer to robot gladiators who can showcase optimal human combat unlike anything we've seen before. Now that will be the pinnacle of spectator sports.
this could be such a good tool for future game animators and/or developers. So interesting
I wonder if we can build upon that to try to improve more efficent human close-quarter combate if is provided with enough material of a variety of martial arts moves, reactions and counters.
that counter attack @ 3:00 isnt really a solid counter punch i wonder if introducing force in to the physics will improve the novel animations created by finding the optimal punch / kick after a specific dodge
4:33 When your drunk aunt and uncle have a slow dance at a family wedding.
Time traveler : "and this my friends , is how the Tesla bots took over humanity "