ฝัง
- เผยแพร่เมื่อ 12 ส.ค. 2024
- Twitter: / cozmouzz
Discord: / discord
Patreon: / cozmouz
Mail: cozmouz@gmail.com
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Video showcases AI trained using Deep Reinforcement Learning.
Music By Epidemic Sounds.
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
artificial intelligence, ai, machine learning, ai learns, deep reinforcement learning, ai training, evolution, neural networks, cozmouz #ai
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Chapters:
00:00 - Intro
00:48 - Neural Networks
01:48 - Reward Function
02:44 - 1st Training Session
03:53 - 1st Training Session Analysis
04:26 - Changes [ Randomization ]
05:06 - 2nd Training Session
06:08 - Transfer Learning & Changes
07:28 - 3rd Training Session
08:06 - 100m in 12.30 sec
08:22 - 100m in 9.74 sec
08:35 - 100m in 7.38 sec [ Best Run ]
09:31 - Endless Runner - วิทยาศาสตร์และเทคโนโลยี
Folks, yes there is air resistance! All bodies in the unity game engine have a setting for "Drag" to simulate fluid resistance. Gravity is set to -9.81. There is inertia and friction as well. The ragdoll's limbs have limited DOF (degrees of freedom) to simulate the human body. The only thing missing is energy cost and fatigue, which even-though sounds really cool, is extremely hard to implement in practice in reinforcement learning. This is primarily why the AI looked explosive towards the end despite having normal joint strength. During my experimentation with energy cost functions, the resulting locomotion is either: [1] almost non existent where the AI resorts to saving energy infinitely or [2] drunk/slow limb movement to save energy. I hope this clarifies any doubts you may have. Cheers!
Did i just read FREEDOM?
Now test this in real life.
You also made it more explosive than any human
i mean he might have ran it faster but if he expends 3x more energy it kinda dosent count, if i had wheels for legs and a v8 for mucles i would "run" faster too. If the energy (useable and how much it can output via any movement) was considered and working the ai wouldnt be flailing its arms and doing wierd steps that are most likely wastefull (or its really the optimal way and we should all run like that though i think most would not be able to and would rip something via that way of running even if it is more efficient).
Why is he running on two legs, maybe on all fours will be faster? A doll should love to experiment and test her abilities. People have tried various techniques to find the perfect one. Why is there only one doll? Several hundred dolls will increase the learning rate by the same number of times.
Bro I didn’t expect the -0.0005 penalty to actually make the AI run like a serial killer is behind them
It also consequentially made it scarier than how any serial killer could run
Like I would not want to turn around and see that coming towards me
So essentially, this AI is running for its life
Yeah right. I don't understand the logic behind this. How it is actually work? In theory, it just like reducing the reward right? How the AI know they must finished faster so they don't get pinalized since it's not even succeed in finish the race in the first place?
Thanks.
@@daryladhityahenrybecause they have real Neural network... they have feelings... Fears... they’re trying to live longer and exist more and “survive”.
@@me-cm8or nope not true, theres no emotions at all. the AI just goes faster because it learnt from previous runs that it gets a lower reward if it doesnt hurry up.
Finally, AI can show us the optimal way to run.
Optimal also takes into account the ammount of injuries you get. The Ai is fast because 1. it has no strength/endurance cap, nor does it experience pain.
😂👍👍👍👍
How funny if we all run Like this
Almost cried when I saw this.
gggghjj tthff Exit keyboard
Usain Bolt needs to adapt this technique
Did someone say adapt?
With this treasure, I summon...
He already retired with big cash and think his age isn't gonna make him faster
@@Topsalesman1981Eight-Handled Sword Divergent Sila Divine General Mahoraga!
@@Topsalesman1981the jjk brainrot im gonna explode
he is swinging his arms and is tilted
9:03 Footage of me running to my bedroom after turning off the lights downstairs
Oh my god I'm dying
5:24 he runs in sync with the beat
@@StillBeingSad I can relate with everything
Overused joke not funny
12 year old joke from a 12 year old kid@@komodo420.
8:49 this is proof all of us learned running wrong. To do it the right way, we need to stagger and flail our arms.
Don't forget the part where you collapse at the end of the run cycle.
facts
don't forget to shake your head and body
you also need to shake yourhead and body as if you're crazy
@@tetra6354 that's what I said
I hope athletes will use this new technic of running at the next Olympics…
Serial killers will make a fortune
nah this simulation the dumbest thing I've seen in my life
Technically it realistic if it was a race with robots, tgis wouldnt be possible for humans because we have pain and we get exhausted@@johnsonfromml8662
@@johnsonfromml8662what did u expect?
@@johnsonfromml8662you have yet to see even dumber things than this video
7:42 bro took "now imagine youre being chased by a serial killer" to heart
true XD
in the end it looked like it was actually running from a serial killer
Even the tripping on air
6:49 penatly for existing *i feel u bro* XD
same
fr, bro's just copying real life
bro is as unlucky as me
😐
A lot more people would watch running competitions if this was how contestants ran.
Also a lot of reason why it runs like that is that it can't shift its joints or flex its upper torso.
ahh ok that makes more sense thanks
Also it has insane stregth too. Nobody can flail their arms that hard nor for that long. Shoulders aren't very strong and have low endurance
I don't like sports but if they ran like that I'll be the first in line to watch that sht
crackhead olympics
I also think that because when people run, they swing their arms by the side of their body, opposite to their leg to cancel the rotational force created by a leg swinging when running, and the AI even with limited range of motion, doesn't have a preference for what is "comfortable" in a sense for arm positions and learned that by swinging the arms above its head, required less speed by the arms to cancel out the rotational force, as the distance from the center of mass to where the arm is swinging is larger, it creates a larger torque on the body, better canceling the rotational force required to pull your leg forward for the next stride. However for most people, raising your arms above your head to run is uncomfortable and the marginal benefit to the AI isn't justified for actual people to use
He's not running, he's falling. He didn't (just) beat Bolt, he set the world record for longest stumble before a fall.
XD
A run can be described as a controlled fall
@@crossbo5345 why does that make sense O.o
Running is just catching yourself from falling
Furthermore regular walking is learning how to almost but not quite fall - I'm sure many of us have seen babies and toddlers learning to walk
6:46
New achievement unlocked: Suicidal
The end is basically Sisyphus but with running.
One must imagine Sisyphus’s happy
Also the bot is in eternal pain for just existing, which was definitely the intent for Sisyphus’s punishment
One has to imagine Sisyphus sweating
I think what it needs is a reference for how to run to help it train better. It kinda reminds me of a baby, but it learns how to move around by watching the ones who raised it. Like feral children move like dogs. Also, it doesn't have to conserve energy and minimize physical damage to its body
Indeed I feel this model has different body parts weights and doesn't contain muscle model at all. It wouldn't be able to run in the real life.
But if we teach it how to run we will be defeating the purpose of the experiment. What we want to gather from this video is a new method to run which is seemingly undiscovered by humans but seems to be more efficient that humans run
@@TooHarshForYou Nobody said this video is about finding a new way to run bro, no offence. We are talking about a game engine here if you read the authors comment right under his video you will even catch a glimpse of him saying that there are a lot of things that are out of his control/too hard to replicate in the engine.
If this was real life the AI would face-plant just like at the beginning of this video, and say this was real life, and you could stick a human in it's position to do that exact run with all the same forces and movements. You would probably finish that run with both ankles dislocated and more than likely a few muscles pulled if not worse.
Although I did notice the same thing that you have watching this video, I'm pretty sure that humans even at their peak would miss some really fine details that could improve ANYTHING that they are trying to accomplish. That is the human limit. Otherwise we would probably be watching a vertical aerodynamic beyblade with limbs that can push itself to the speed of light.
7:23 sounds like real life
Sounds like Mr meeseeks
This is me learning to walk again after standing up to fast and everything goes black for 10 seconds
Postural hypotension
I swear I felt every bone crack in that ai’s body when he beat Usain bolt 😖🤣
You made roling 😂
Petition to make an AI to train entirely as a ninja. Do different scenarios, like: shuriken throwing at a targets, katana targets to cut (or just hit) and doing parkour above pillars
where do I sign?
1:20 uh did i see what i just see?
yep. Ai weinor
No ai butt
Why is it that small?
Lol this is root global orientation called pelvis
1:20 yeah damn😅
the ai's whole life goal was run, get treat, run faster, more treat, beat usain bolt
I almost died laughing at 7:33 💀
Same
The AI: I almost died today and you're laughing?
Not even lying a chocked on my spit💀
@@andderson1024The Ai: I amost died
lol same
this is seriously cool, I love these videos where they train AI to do random stuff
Yeah same
5:37 me off my third bottle of cough syrup outside the gas station
💀
8:28 I want to see someone do this at the Olympics!! 😂
🤣🤣
I guess with this technique the runner reaches results of 15 secs for 100m
You would need a SK for that
8:36 me omw to greet the woman walking alone at night (I'm such a good person)
First time seeing an underrated comment
I always wonder why they run screaming am just a nice guy
8:02 seing him run like that really make me understand the serial killer Metaphor 😂
You should penalize for using its muscles to get more efficient moving and less flailing
the person that made the ai wants the ai to go as fast as possible.
the person that made the ai doesen't care if it looks unnatural.
@@patrickstening Then why not give it wheels? My point was to give it realistic constraints. A human would not be faster with that kind of movement, so the AI did not find a faster way to run.
@@Kaepsele337the title is "Ai learns to run faster than usain bolt" the ai has succeeded in this. There is no lie
but he doesnt run faster than usain bolt he runs faster than usain bolt simulation in a simulated world
@@it_will_be_ok.this is irrelevant. No one has said the robot can run faster than usain bolt irl. (Because it doesnt exist irl) though it could if it did. So no lie has been told
A whole new meaning to "existence is pain."
The 2nd training session was actually such a smart way to force the AI to use both legs
Really nice video. Can't wait to see the next one 👏🏻
Great video all around! Keep it up!
7:53 oh nah, it's going full oogly goo
this is one of the first AI training videos where it feels like the creator actually knows what they are doing
bro i cant take this shit serious with that running
1:42 dang i feel smart now
Keep dreaming buddy (this is a joke)
this is insanely interesting to watch, its like watching a new life learning how to walk and run but in a youtube video, this might be a top 10 youtube video ive ever watched
*That is how I run to the toilet when getting home, after driving for hours and not stopping..* 🏃🏼💨
Great choice in the montage music. Also very cool video👏
Man i hope you model your future videos on this format. This was so much fun to watch, compared to your earlier videos. Hope this video blows up and you get a ton of subscribers soon
bro really wanted that reward 8:41
You'd likely get more natural movement, eventually, if you could penalize joint and tendon strain appropriately.
**trains the AI how to walk**
**proceeds to change the AIs body, and now it has to learn to walk again**
bruh.
The ai could be a boxer with those flailing arms. Very good technique.
Underrated comment 😂
Imagine you release this video and wake up tomorrow to the running community losing their minds about the new technique that was discovered by AI.
7:45 is literally how our class runs at school
Cool idea, well explained concepts without going too in dept, ngl my friend you have everything in order to be a great content creator
this experiment would be so much more interesting if you could limit the force the ai can apply on each joints, to the same strength as usain bolt, so the ai as to really use the technic instead of pure strength
5:30
looks like he had a tantrum 😅
give it more reward for exceeding the target velocity
Very informative and entertaining!
6:00 me walking to the fridge to get another beer
9:40 me on my way to work after hitting snooze 3-4 times
Hes walking like A baby from first steps❤ 5:15
It looked adorable 😭
(Proceeds to crack his head on floor)
You earned my subscription
What a great and optimised TAS!
Probably saves some frame rules too.
My dad every night 3:25
Boogie😂
LMAO 💀😭🍻🍻
70kg for 6ft is genuinely so underweight, bro should go on a bulk
I am 58 kilos and 6 ft lol
@@MLG4TheWin twig lol
@@IronOre33 that's crazy
@@MLG4TheWin bro im jk
@@MLG4TheWin chill
This video is a great mix of funny and educational. Less than 6 thousand subscribers?! I hope your channel blow up.
He definitely looks like a serial killer is following him. Loved the video btw! Very educational too
Please don't use generative slow motion fps increase thing, it doesn't look good. It just makes it harder to understand what's going on.
Besides that, beautiful video. Now I will use this new running technique to go to work everyday. Hop I don't fall off :D
doesnt count. You should add heat generated from muscles, overall energy efficiency and probably a few more things to make this belivalbe new word record
he is faster tho
@@aaz.2007more like a car
@@aaz.2007 if people didnt need to worry about heat from myscles, speed of delivering energy to the cells and all this stuff, they too would probably be just as fast as this AI
Yup, there are hardly any constraints tethering this experiment to the real world. Kinda meaningless tbh.
Too complex, also even if we did simulated all human limitations on the program, what would we base these limitations on? After all no matter how much some people train, they'll never surpass Usain Bolt, as their limitations are greater than him's.
So at that point, you'll just be making an AI that has Usain's limitations (impossible to accurately know and thus code), which would mean the AI would beat him comfortably given enough time.
8:35 Bro is fighting his demons while breaking Usain bolt's record, Respect.
Funny 🤣
New subscriber unlocked
Not trying to hate but....this is just silly.
Millions of years of developing and we finally found the most optimal way to run.
5:11 POV: youre trying to sleep but you hear the ice cream man outside your house...
I love relearning what a neural network is every time I watch an ai video
Pretty sure this teaches us more about the limitations of the unity game engine as a physics simulator than about how fast an android might one day run
nobody gonna talk about this dudes edits? shits so fire for 10k subs bro is working hard
Well I love those videos, where AI learns to do something in record time. But to be fair. For a real competition, there should be a physical simulation, with mass and inertia, as well as simulated muscle power and an energy budget for the AI to spend on movement.
The wild flailing with the arms seems accurate in your story about a serial killer chasing the poor AI
Bro I thought your channel would have millions of subs with this level of quality
9:21 an actual video of me running to my bed after work.
This really is all so cool!
Really hoped the Ai will at some point use perfect sprinting technique. Nice video man!
This is awesome! I’m familiar with AI, ML, Deep Learning, etc. but have not worked with simulation in the unreal engine. I’d like to experiment with things like this. Any recommendations on where to start?
genuine question, do u mind educating me how do u use the same AI for those 3 training sessions? Like u fine-tune the first version to become a second version or what?
Sprinting coaches need to see it and learn this revolutionary running style.
Gonna learn to crawl before you walk, walk before you run. Great video
Dude, that was amazing!!!! 😂😂😂
I’m just mad I didn’t get to see a final race between the two 🤣
Will definitely adapt this technique next time I run
8:49 Drunk Dream when he sees a child
8:00 you should make this a horror game but it would be so goofy 😂
5:23 the beat perfectly lines up with his footsteps 😂
it literally just teaches itself to fuck with the engine's physics to go freakishly faster
8:49 The run I do when there are dogs chasing me 👟💨
how do you make the ai? its realy entertaining to watch them move and i wonder how to try to create one myselfe :D
What’s interesting is that you can see hints of how humans run- the movements are of course pretty weird due to the complete double-jointed existence of this creature; but it uses really fast steps to accelerate (a good tactic for short sprints if you don’t have footholds to push off from), pumps the arms to create momentum, and even runs with its body fairly upright, which is proper running form. We’ve been hashing out how to run fast for a long time, so it makes sense that the AI piloting a humanoid body would end up with the same general approach. And it does all this without toes, which are normally pretty vital to the process as sprinters will be up on their toes while rocketing toward the finish line.
I'll be sure to use this running technique.
7:31 Bro is running for his dear life after being punished for existing.
ok now teach the ai abt physical pain, mental challenges, add sweating and randomness to the physics, simulate the ground particles changing, add heartrate so it can only train a little bir per time and has to take breaks, make it have a personal life, a family, make it have troubles in it's family and have problems keeping up a stable life,
An interesting component of this type of running is that it would actually be highly efficient to just jerk the upper body side to side instantly if our spine could handle it. The way we run is not only limited by our number of joints, but also the desire to not stress them.
I will begin my training with this new optimized technique!
Yoo this is so sick! I think this means that we should all copy the robots running technique.
Seems you could incorporate an energy efficiency model as well. Assigning energy expenditure to movements based on length of movement verses distance traveled.
Watching this guy grow is gonna be crazy.
I need to learn that olympic floppy fish running running technique.
He really took the “is like you are followed by a serial killer” too personal.
Among Us characters when the speed is set to 2: hold my beer.