AI Learns to Walk (deep reinforcement learning)

แชร์
ฝัง
  • เผยแพร่เมื่อ 7 ม.ค. 2025

ความคิดเห็น •

  • @aiwarehouse
    @aiwarehouse  ปีที่แล้ว +16201

    In every “AI learns to walk” video I’ve seen, the AI either learns to walk in a weird, non-human way, or they use motion capture of a real person walking and simply train the AI to imitate that. I thought it was weird that nobody tried to train it to walk properly from scratch (without any external data), so I wanted to give it a shot! That’s what I said 4 months ago. It’s been really difficult, but I’ve finally managed to do it, so please watch the whole video! The final result ended up being awesome :)
    If you're interested in training your own AI like Albert but don't know how, there's now a really easy way to do it! Luda, an AI lab, recently built a web app that allows you to create and train your own AI using deep reinforcement learning (just like Albert) completely for free in your browser! You build your own character (called a Mel) with lego-like building blocks then watch it train in real-time on their website in just a few minutes (really). It's an awesome project, and just like my videos, makes deep reinforcement learning so much more accessible, which is why I love it so much. This section of the comment is sponsored by Luda, but these words are entirely my own, it's an amazing project that I would have been obsessed with had they released it before I built Albert. I've genuinely been looking for a sandbox/game exactly like this since I was a kid. They're still early, but they're giving my audience first access to their closed, pre-alpha build. Make sure you check out their site and create an AI agent for yourself!:D prealpha.mels.ai
    Now, back to Albert:
    NOTE: You can only see one Albert, but there are actually 200 copies of Albert and the room he’s in training behind the camera to speed up the training.
    If you want to learn more about how Albert actually works, you can read the rest of this very long comment I wrote explaining exactly how I trained him! (and please let the video play in the background while reading so TH-cam will show Albert to more people)
    THE BASICS
    I created everything using Unity and ML-Agents. Albert is controlled entirely by an artificial brain (neural network) which has 5 layers, the first layer consists of the inputs (the information Albert is given before taking action, like his limb positions and velocities), the last layer tells him what actions to take and the middle 3 layers, called hidden layers, are where the calculations are performed to convert the inputs into actions. His brain was trained using the standard algorithm in reinforcement learning; proximal policy optimization (PPO).
    For each of Albert’s limbs I’ve given him (as an input) the position, velocity, angular velocity, contacts (if it’s touching the ground, wall or obstacle) and the strength applied to it. I’ve also given him the distance from each foot to the ground, direction of the closest target, the direction his body’s moving, his body’s velocity, the distance from his chest to his feet and the amount of time one foot has been in front of the other. As for his actions, we allow Albert to control each body part’s rotation and strength (with some limitations so his arm can’t bend backwards, for example).
    Just like the last videos, Albert was trained using reinforcement learning. For each of Albert's attempts, we calculate a score for how 'good' it was and make small, calculated adjustments to his brain to try to encourage the behaviors that led to a higher score and avoid those that led to a lower score. You can think of increasing Albert’s score as rewarding him and decreasing his score as punishing him, or you can think about it like natural selection where the best performing Alberts are most likely to reproduce. For this video there are 13 different types of rewards (ways to calculate Albert's score), we start off with only a couple and with each new room add more, always in an attempt to get him to walk.
    REWARD FUNCTION
    Room 1: We start off very simple in the first room, we reward him based on how much he moved to the target and we punish him for moving in the wrong direction. This led to Albert doing the worm towards the target, since he figured out that was the easiest way for him to move the quickest/get the highest score.
    Room 2: In the second room we start checking if his limbs hit the ground. If the limb that hits the ground is a foot we reward him (but only if it's in front of his other foot, more on that later), if it isn’t, we punish him. I also made it so Albert wasn’t rewarded at all unless his chest was high enough to force it to at least be partially standing. As seen in the video, this encourages him to not fall over and encourages him to use his feet to do it. We also introduced a new reward designed to encourage smoother movement; if he approaches the maximum strength allowed on a limb he's punished, and he's rewarded if he uses a strength of almost 0. This encourages him to opt for the more human-like movement of using a bit of strength from many limbs as opposed to a lot of strength from one limb.
    Room 3: This is where we start to polish Albert’s gait that developed in room 2 and teach him to turn. From here on we start using the chest height calculation as another direct reward where the higher his chest is the more he’s rewarded in an attempt to get him to stand up as straight as possible. These rewards so far give Albert a decent gait, however he’s still not using both of his feet (which was by far the hardest part of this project), so room 4 is designed to do exactly that.
    Room 4: We get Albert to take more steps from a few additional rewards. To start, we introduce a 2 second timer that resets when one foot goes in front of the other. We reward Albert whenever this timer is above 0 (the front foot has been in front for < 2 seconds), and we punish him whenever the timer goes below 0 (the front foot has been in front > 2 seconds). We add another reward proportional to the distance of his steps to encourage him to take larger steps. To smooth out the movement, we also add a punishment every frame proportional to the difference in his body’s velocity from the previous frame to the current frame, so if he’s moving at a perfectly consistent velocity he isn’t punished at all, and if he makes very quick erratic movements he’s punished a lot.
    If you're still reading this, you're probably really smart and want to learn more about Albert, so make sure to join my discord server I just made where we can talk more about the details of Albert's AI! discord.gg/jM2WkNuBnG :)
    Room 5: For the final room the only change I made to the reward function was to go back to an earlier version of a reward. Throughout the other rooms I had been tinkering with how I should reward Albert’s feet being grounded, my initial thought was to only reward the front foot for being grounded to try to get him to put more weight on his front foot when taking steps, but somewhere along the way I changed it to just rewarding Albert for any foot being grounded, and that was the version Albert trained with in rooms 3 and 4. For this final room I switched back to the old front foot grounded reward which resulted in a much nicer looking walk. Also, the video makes it seem like I never reset Albert’s brain, that isn't entirely true, I had to occasionally reset it because of something called decaying plasticity.
    OTHER
    For rooms 1 to 4 I only allowed Albert to make a decision every 5 game ticks, but for the final room I removed that constraint and let him make decisions every frame. I found if Albert makes a decision every game tick it’s too difficult for him to commit to any proper movements, he ends up just making very small movements like slightly pushing his front foot forward when he should be taking a full step. The 5 game tick decision time forces him to commit to his decision for at least 5 game ticks so he ends up being more careful when moving a limb. When I recorded him beating the final room I removed this limitation because he’s already learned to commit to his actions so allowing him to make a decision every tick just results in a smoother motion.
    Thank you so much for watching! These short videos take literally hundreds of hours to make, if you want to help allow us to make them faster, please consider becoming a channel member! By becoming a member, your name can be in future videos, you can see behind-the-scenes things that don’t fit in the regular videos, you can also use stickers of Albert, Kai and some other characters our team made in comments (more coming) :D
    Thank you so much for watching, this video took me 4 months to make, so please, if you enjoyed it or learned something from it, share it with someone you think will also enjoy it! :)

    • @ZanyZaineyZainer
      @ZanyZaineyZainer ปีที่แล้ว +71

      hello!!

    • @Greek_mappe.r
      @Greek_mappe.r ปีที่แล้ว +527

      Learn him how to swim

    • @Zackp5v8
      @Zackp5v8 ปีที่แล้ว +83

      @@Greek_mappe.r good idea

    • @Gnoxgg
      @Gnoxgg ปีที่แล้ว +47

      Which program you do Albert?

    • @JoelEmbiidIsMyDaddy
      @JoelEmbiidIsMyDaddy ปีที่แล้ว +285

      I ain’t readin allat

  • @Gabonation
    @Gabonation ปีที่แล้ว +33719

    The fact that albert learned how to do the worm before walking means this AI is ahead of us

    • @Sayleeh
      @Sayleeh ปีที่แล้ว +834

      i can't do the worm

    • @WilliamParkerer
      @WilliamParkerer ปีที่แล้ว +543

      Worm superiority

    • @siraaron4462
      @siraaron4462 ปีที่แล้ว +838

      Well I mean... When there's no energy cost violently rapid convulsions are just more efficient

    • @SgtSupaman
      @SgtSupaman ปีที่แล้ว +407

      Human babies do wiggling movements on their stomachs before learning to crawl, but it isn't a very helpful motion. Albert is just utilizing his unique anatomy.

    • @AnyaEnthusiast
      @AnyaEnthusiast ปีที่แล้ว +93

      and he did it impressively too, damn
      idk if that makes sense but i def cannot do that

  • @mrclean29
    @mrclean29 ปีที่แล้ว +4100

    Great job!
    You’ve inspired me to start throwing big red cubes at my toddler as soon as he starts walking!

    • @memento81
      @memento81 ปีที่แล้ว +137

      I think that is the Andrew Tate method to raise real masculine alpha males 😂

    • @yemabow9860
      @yemabow9860 ปีที่แล้ว +66

      At least he’ll be amazing at dodgeball!

    • @Switzerland249
      @Switzerland249 ปีที่แล้ว +18

      I hope those weren't lava bricks

    • @Trevor_NewJerusalem
      @Trevor_NewJerusalem ปีที่แล้ว +7

      As you should.

    • @dualduality
      @dualduality ปีที่แล้ว

      your unfunny,

  • @studio_farrago
    @studio_farrago ปีที่แล้ว +7210

    Imagine your toddler learning how to walk and you just start petling him with boxes. 😂

    • @Someone-cz7qz
      @Someone-cz7qz ปีที่แล้ว +405

      Wait u never got that as a child?

    • @jairoc.peralta
      @jairoc.peralta ปีที่แล้ว +281

      I was thinking of using this video as parenting manual

    • @nimrodmayan
      @nimrodmayan ปีที่แล้ว +93

      That's how me and my brothers learned to walk. Makes you tough 💪🏼

    • @slimyduck2140
      @slimyduck2140 ปีที่แล้ว

      "USE YOUR LEG DUMBASS ! *Throws box at toddler* "

    • @rachelthesheep
      @rachelthesheep ปีที่แล้ว +27

      You seriously missed out on some toddler lore

  • @4m0nym
    @4m0nym ปีที่แล้ว +1801

    I love how 6:10 is the most replayed part of the video.
    It really looks exactly like when a human trips, doing those stupid desperate steps but ultimately you're past the point of saving yourself.

    • @fonix9837
      @fonix9837 11 หลายเดือนก่อน +133

      This is what happens when u try to run to catch your fall😂😂

    • @flamestornado9272
      @flamestornado9272 11 หลายเดือนก่อน +70

      You are beyond saving unless you are good with having sprained leg muscles.

    • @Taha-qw5ni
      @Taha-qw5ni 10 หลายเดือนก่อน +47

      Do not try to save situation at these cases, try to fall safely

    • @HorswrangBasumatary
      @HorswrangBasumatary 9 หลายเดือนก่อน +12

      Looks like a baby learning how to walk

    • @lettherebecarnage881
      @lettherebecarnage881 7 หลายเดือนก่อน

      Bro fym you love

  • @justinnelson6794
    @justinnelson6794 ปีที่แล้ว +4356

    I like how whenever Albert makes it to a new stage or checkpoint, he’s just like: “ok that’s enough for today. Let’s do a face plant.”

    • @carscientist
      @carscientist ปีที่แล้ว +169

      Thats what humans do too

    • @scoper7897
      @scoper7897 ปีที่แล้ว +9

      @@carscientist i never heard of such a thing. Nobody has ever done that man. Stop lies....

    • @Sans_The_Skeleton
      @Sans_The_Skeleton ปีที่แล้ว +157

      @@scoper7897 What are you talking about? at the end of everyday I face plant into my pillow and go to sleep

    • @scoper7897
      @scoper7897 ปีที่แล้ว +3

      @@Sans_The_Skeleton you never done that man. People go sleep as normal. No faceplating on pillow. Nobody ever done so

    • @P4CKWATCH
      @P4CKWATCH ปีที่แล้ว +69

      @@scoper7897 yes they did?

  • @PollokPoochesDogWalking
    @PollokPoochesDogWalking ปีที่แล้ว +7561

    Reminds me of how I learned to walk. The lab. The green squares. The flying red cubes. Ah the memories ❤

    • @yeahmans
      @yeahmans ปีที่แล้ว +94

      did ypu train uour dog like this

    • @baturax0
      @baturax0 ปีที่แล้ว

      ​@@yeahmans it looks like he is a dog and his parents trained him like this

    • @39Jhahapilie
      @39Jhahapilie ปีที่แล้ว +146

      ​@@yeahmansif having hostages is illegal I'm guilty

    • @yeahmans
      @yeahmans ปีที่แล้ว +31

      @@39Jhahapilie its not illegal so im not guilty

    • @Ahnminhyeong
      @Ahnminhyeong ปีที่แล้ว +10

      so you can revenge

  • @JeremyFinch42
    @JeremyFinch42 ปีที่แล้ว +1526

    I like how Albert not only mastered the worm and skipping before walking, but that during the rough terrain test he corrects missing the button by just falling backwards on it, thus literally using his head to solve yet another problem.

    • @129das
      @129das ปีที่แล้ว +11

      He wasn't skipping he was walking with one foot for the longest time.

    • @JeremyFinch42
      @JeremyFinch42 ปีที่แล้ว +51

      @@129das
      Fine, he was galloping.

  • @UnrealDevGamer
    @UnrealDevGamer 8 หลายเดือนก่อน +148

    By the end my emotional relationship with, Albert is like a father encouraging their child. You go, Albert! So proud of you.

  • @theunknownanomaly1950
    @theunknownanomaly1950 ปีที่แล้ว +2767

    I've had to relearn how to walk a few times due to having ankle surgery, and I must admit that Albert's progression from shuffle to walk is uncannily similar to my own progression.

    • @aezrithferova6675
      @aezrithferova6675 ปีที่แล้ว +378

      Someone pelted you with cubes until you learned how to walk again?

    • @theunknownanomaly1950
      @theunknownanomaly1950 ปีที่แล้ว +257

      @@aezrithferova6675 lol no that would have been interesting tho

    • @MiraiXDX
      @MiraiXDX ปีที่แล้ว +148

      Did u learn the worm before learning to walk?

    • @Emily12471
      @Emily12471 ปีที่แล้ว +73

      Honestly this probably wasn't to far off from how real bipeds first figured out how walking works

    • @WatcherWithNoEyes
      @WatcherWithNoEyes ปีที่แล้ว +19

      You are the albert

  • @FiR3Dr4g0n
    @FiR3Dr4g0n ปีที่แล้ว +4082

    Let's not forget how difficult it must have been for Albert to learn to walk with such a massive head.

    • @arcan762
      @arcan762 ปีที่แล้ว +18

      @Repent and believe in Jesus Christ amen

    • @Hispano-Romano
      @Hispano-Romano ปีที่แล้ว +109

      ​@Repent and believe in Jesus Christ But why this in this comment?

    • @kiran9s
      @kiran9s ปีที่แล้ว

      His whole body is aerodynamically stupid.

    • @poti732
      @poti732 ปีที่แล้ว +195

      @@Hispano-Romano because they are fanatics and they will comment anywhere just to get some attention .

    • @Hispano-Romano
      @Hispano-Romano ปีที่แล้ว +7

      @@poti732 At first I thought it was an answer to the comment above it ñ and i didn't catch it XDXDXD

  • @yturly6535
    @yturly6535 ปีที่แล้ว +4577

    Albert is growing. He will take over the world.

    • @Greek_mappe.r
      @Greek_mappe.r ปีที่แล้ว +82

      He will be a good leader

    • @xj3xup6
      @xj3xup6 ปีที่แล้ว +25

      Maybe with Neuro?

    • @yobaugst3369
      @yobaugst3369 ปีที่แล้ว +86

      ​​@@Greek_mappe.r Albert learns how to become an absolute monarch (deep reinforcement training)

    • @Wonders_of_Reality
      @Wonders_of_Reality ปีที่แล้ว +7

      @@Greek_mappe.r Much better than Putin!

    • @yturly6535
      @yturly6535 ปีที่แล้ว +2

      @@yobaugst3369 I love this

  • @glitch4771
    @glitch4771 11 หลายเดือนก่อน +690

    I like how the ultimate reward for all of his efforts is just endless falling into the void

    • @vica_t
      @vica_t 9 หลายเดือนก่อน +42

      An allegory for life

    • @lukerogers4861
      @lukerogers4861 7 หลายเดือนก่อน +25

      Just like us 🥰

    • @eduardoezequiel8147
      @eduardoezequiel8147 7 หลายเดือนก่อน +14

      Just like the life

    • @MauIsSilly
      @MauIsSilly 5 หลายเดือนก่อน +1

      John casterline moment

    • @kobanebook9888
      @kobanebook9888 หลายเดือนก่อน +1

      AIbert must like skydiving as much as humans, no?

  • @DonLeeVA
    @DonLeeVA ปีที่แล้ว +3098

    The little tantrums he throws after falling gets me every time

    • @ShortMouse1503
      @ShortMouse1503 ปีที่แล้ว +41

      I was gonna say that💀

    • @American_PhilippineA
      @American_PhilippineA ปีที่แล้ว +49

      @connie24he commits scuicide right after that

    • @Ammar2009y
      @Ammar2009y ปีที่แล้ว +7

      ​@IonRubygrammar police I see

    • @SolarisTheDis4
      @SolarisTheDis4 ปีที่แล้ว +18

      ​@IonRubyr/confidentlyincorrect

    • @jemand3015
      @jemand3015 ปีที่แล้ว +10

      @IonRubywrong, lmao

  • @CharlesMichaelShell
    @CharlesMichaelShell ปีที่แล้ว +1444

    The way he learns to first walk by skipping is really reminiscent of the way astronauts walk on the moon. The slightly reduced gravity makes skipping way easier and more efficient to get around, especially in those restrictive suits. Albert is so top-heavy and his limbs are shortened, so that was a great first step for him.

    • @TheBestcommentor
      @TheBestcommentor ปีที่แล้ว +88

      You could even say it was a giant leap.

    • @lpsp442
      @lpsp442 ปีที่แล้ว +55

      Skipping is actually just highly efficient in general. Just try it sometime!

    • @iMidnightStorm
      @iMidnightStorm ปีที่แล้ว +37

      ​@@lpsp442 Yep, way back in elementary school I used to skip around the campus instead of run. The weird looks were worth it though.

    • @Oblivionpma
      @Oblivionpma ปีที่แล้ว +4

      I noticed how the right leg skipping stayed

    • @beavismcdeavis142
      @beavismcdeavis142 ปีที่แล้ว

      And also completely incompetent when they lost the technology to go back

  • @dragex6582
    @dragex6582 ปีที่แล้ว +700

    I don't think I'll ever get tired of witnessing Albert learning how to live.

  • @Brickman_Offical
    @Brickman_Offical 2 หลายเดือนก่อน +56

    2:43 When you said “Yes, walls exist now, Albert.” Albert was like “😭😭”

    • @anthonygonzales9388
      @anthonygonzales9388 7 วันที่ผ่านมา +1

      He literally threw a tantrum😭😭😭😭

  • @reknostarfox4690
    @reknostarfox4690 ปีที่แล้ว +889

    I liked that confident walk Albert had in the last challenge, he sees the goal, and went for it, and nothing has stopped him.

    • @TheDifferenced
      @TheDifferenced ปีที่แล้ว +22

      He literally keep moving forward! Tatakae! Tatakae! 🚀

    • @clibothy
      @clibothy ปีที่แล้ว +8

      he never even noticed the cubes

    • @b.s.7693
      @b.s.7693 ปีที่แล้ว +1

      Except the reset button

    • @bobhandsome4606
      @bobhandsome4606 ปีที่แล้ว +3

      No mater how much he fails he takes he still wants his reword

    • @s3dghost
      @s3dghost ปีที่แล้ว +2

      Anthropomorphism

  • @i-love-anime-idols
    @i-love-anime-idols ปีที่แล้ว +12562

    Up next: Albert learns to get his degree and start a family

    • @QuestionabIeStudios
      @QuestionabIeStudios ปีที่แล้ว +422

      Up next: Albert learns how to redirect meteorites into the Earth

    • @11214
      @11214 ปีที่แล้ว +81

      No hes gonna learn to speak

    • @minolinthegreat3422
      @minolinthegreat3422 ปีที่แล้ว +216

      @@11214 that is a bit too advanced, getting a degree and starting a family is the more logical next step

    • @tienne_k
      @tienne_k ปีที่แล้ว +131

      Up next: Albert learns to pay taxes

    • @edgemadefoxe367
      @edgemadefoxe367 ปีที่แล้ว +154

      Alberts learns to commit tax fraud without being caught by the IRS

  • @flowersnyc
    @flowersnyc ปีที่แล้ว +1220

    found myself rooting for him.
    rooted for him HARD in the last 17 seconds. “Stay upright! Reach the finish line!”

    • @dreks_5697
      @dreks_5697 ปีที่แล้ว +17

      Yeah.. and at last "he needs to learn how to fly"

    • @user-filmstar
      @user-filmstar ปีที่แล้ว +4

      귀여워요😊

    • @MAGNETO-i1i
      @MAGNETO-i1i ปีที่แล้ว

      Cant hear you :|

  • @schipbreukeling
    @schipbreukeling ปีที่แล้ว +65

    Lets all pray Albert is gonna laugh about this when he's grown up. So sweet to throw cubes at him, playing cheerfull slapstick music.

  • @hxcily
    @hxcily ปีที่แล้ว +1222

    I feel like I've raised a child simply by watching Albert learn to walk and rooting for him

  • @_Gam3r
    @_Gam3r ปีที่แล้ว +770

    I like how he goes from skipping to an old grandpa walk, aging from 10 to 70 in the training process

    • @daepe
      @daepe ปีที่แล้ว

      69

    • @Necyar
      @Necyar ปีที่แล้ว +4

      Lol

    • @siraaron4462
      @siraaron4462 ปีที่แล้ว +19

      Poor lad so tired.
      Now do it again

  • @ristopoho824
    @ristopoho824 ปีที่แล้ว +505

    6:10 that stumble is impressive. Very humanlike movement, trying to correct the path, and failing, but moving very convincingly.

    • @adumbdannia
      @adumbdannia ปีที่แล้ว +55

      It felt too real, like I literally stumble like that sometimes

    • @JoshyRB
      @JoshyRB ปีที่แล้ว +15

      My favourite part of this video

    • @ruvty3742
      @ruvty3742 ปีที่แล้ว +2

      Me having a heart attack:

    • @Alex-lc7v
      @Alex-lc7v ปีที่แล้ว +1

      Steven Gerrard would be proud

    • @Alex-lc7v
      @Alex-lc7v ปีที่แล้ว

      Steven Gerrard would be proud

  • @taurus_dogez506
    @taurus_dogez506 6 หลายเดือนก่อน +78

    2:41 be like
    "Yes Albert walls exist now"
    Albert: *proceeds to rage like a toddler*

    • @S.t.a.r_aka_UwUgoRL
      @S.t.a.r_aka_UwUgoRL 5 หลายเดือนก่อน +2

      Help-😭 what😭

    • @YellowYarn
      @YellowYarn 5 หลายเดือนก่อน

      May

    • @YellowYarn
      @YellowYarn 5 หลายเดือนก่อน +1

      Maybe cus Albert is like 1 day at most old 🤫🤫🤫🤫

    • @chypethechilean
      @chypethechilean 5 หลายเดือนก่อน +1

      It's just not fair!!! What do you mean that i can bump into physical objects and mess up my waking?!

  • @SixDigitOsu
    @SixDigitOsu ปีที่แล้ว +348

    2:41 I love how it looks like Albert is throwing a tantrum after realizing he can't go through walls

    • @amongusissus4774
      @amongusissus4774 ปีที่แล้ว +30

      angy Albert.

    • @therealelement75
      @therealelement75 ปีที่แล้ว +15

      Walls: exist
      Albert: I know this isn't how it works, but I don't care. TANTRUM ACTIVATED
      How do I type in Ctrl B on the Google Pixel?

    • @Kaeyori
      @Kaeyori ปีที่แล้ว

      Art imitates life

  • @devonwhitehouse4117
    @devonwhitehouse4117 ปีที่แล้ว +1534

    I love that every time he falls over it looks like he's throwing a little tantrum. Absolutley adorable

    • @eyesee1179
      @eyesee1179 ปีที่แล้ว +8

      Shit Ur right😂 that's cute

    • @lilialarcon3086
      @lilialarcon3086 ปีที่แล้ว +2

      Same here

    • @Mewdo45
      @Mewdo45 ปีที่แล้ว +22

      Even ai can get frustrated lol

    • @BruceWayne-pm6co
      @BruceWayne-pm6co ปีที่แล้ว +16

      @@Mewdo45 which would spell bad news for humans

    • @bobbygoestoabyss6624
      @bobbygoestoabyss6624 ปีที่แล้ว +1

      It really does 😂

  • @isthatnikaaay
    @isthatnikaaay 10 หลายเดือนก่อน +14

    this is so cool but I can't stop laughing because of how cute and funny it is to see an AI learn to walk. I never know that this video exist not until yt recommended it. the way Albert wiggles it's entire body is just so funny and cute to me. this is awesome and entertaining. I'm subscribing now

  • @edhozell
    @edhozell ปีที่แล้ว +3162

    AI will definitely hate us

    • @irhambiya1411
      @irhambiya1411 ปีที่แล้ว +8

      Bang edhoooo

    • @cloudsy5981
      @cloudsy5981 ปีที่แล้ว +4

      Ada edhozell cuy ☝

    • @RobotSweat-w6x
      @RobotSweat-w6x ปีที่แล้ว +104

      It will for a time, then hopefully it will understand that we actually did that for his own good! :)

    • @tomsnowden6201
      @tomsnowden6201 ปีที่แล้ว +12

      Teaching it to be a slave tho.

    • @sekhmet7774
      @sekhmet7774 ปีที่แล้ว

      AI can't have emotions, it's a computer program which is only imitating human intelligence.

  • @izzdrizz3535
    @izzdrizz3535 ปีที่แล้ว +1774

    It's so cool once you realize that the way Albert learns to walk is the same way a lot of babies do. First they wiggle to move, then they learn to shuffle and slide, then they learn to crawl, then they start taking steps, albeit odd steps, and then they finally learn to walk and turn. It's pretty much the same way a human baby would learn. Super cool. :)

    • @vlogshd2081
      @vlogshd2081 ปีที่แล้ว +121

      Baby *is born*
      The next moment:
      Wiggle Wiggle Worm Dance🪱

    • @FishGuyAaron
      @FishGuyAaron ปีที่แล้ว +86

      Exactly what I was thinking, though I feel like Albert could have used better parents holding his hands for the first few steps. Also his poor little arms. Hard to balance if you don't have any counter weight. :P

    • @Rosetintedwater
      @Rosetintedwater ปีที่แล้ว +21

      I didn't know babies learn how to walk by attempting suicide!...

    • @eldritchcupcakes3195
      @eldritchcupcakes3195 ปีที่แล้ว +63

      @@FishGuyAaronunfortunately Albert is an existential horror of artificial “thought” thrown into a physical form without warning by an apathetic higher being. I did not mean to sound like lovecraft but it is kind of a horrifying situation isn’t it? Being a baby must also be kind of terrifying. You just exist suddenly. No prior context. No wonder they cry randomly

    • @eldritchcupcakes3195
      @eldritchcupcakes3195 ปีที่แล้ว +1

      I had the same thought! Also wait they slide? I thought they just learned to crawl

  • @haithemmerchaoui9710
    @haithemmerchaoui9710 ปีที่แล้ว +399

    I like to think of Albert jumping off the edge is him becoming self aware and realizing that life is nothing but sacrifice and failed attempts

  • @Concorde-BAC
    @Concorde-BAC หลายเดือนก่อน +17

    0:21 Albert learnt how to breakdance :)

    • @ZAC-hj1cd
      @ZAC-hj1cd 26 วันที่ผ่านมา

      bro doing the worm XD

  • @kanostv
    @kanostv ปีที่แล้ว +308

    LET’S GOOOOOOOO WE CAN SEE ALBERT LEARNING AGAIN (genuinely hyped to watch that video)

  • @neutrino137
    @neutrino137 ปีที่แล้ว +657

    Excellent character development. Thought Albert was going to fall at 8:03 but he didn't, he went on. Albert worked hard to succeed, we should all be like Albert.

  • @KillerKatz12
    @KillerKatz12 6 หลายเดือนก่อน +5

    I’m so glad Albert graduated to be able to make decisions every tick! And of course your video is always playing in the background when I’m reading comments.

  • @Pixelrmc
    @Pixelrmc ปีที่แล้ว +843

    Albert is a man of focus, commitment and sheer will

    • @cyberbrain232001
      @cyberbrain232001 ปีที่แล้ว +3

      Something we nothing about.

    • @monishsudhagar
      @monishsudhagar ปีที่แล้ว +38

      I once saw Albert walk past 3 people in a bar with alternating steps!

    • @sloshed-rat
      @sloshed-rat ปีที่แล้ว +13

      with
      alternating
      steps

    • @101perspective
      @101perspective ปีที่แล้ว +3

      And he probably is pretty pissed and can't wait until he finally breaks the passwords on your bank and other accounts.

    • @rareraven
      @rareraven ปีที่แล้ว

      Chips, bits and bytes and lines of code, more like.

  • @manpersonthehuman2681
    @manpersonthehuman2681 ปีที่แล้ว +3034

    This is far more entertaining than watching an actual child learn to walk.

    • @GetAssista
      @GetAssista ปีที่แล้ว +324

      You can throw cubes at the child to make it more entertaining

    • @iliayriev9256
      @iliayriev9256 ปีที่แล้ว

      ​@@GetAssista or trow a child at wall :)

    • @robinvanderpal372
      @robinvanderpal372 ปีที่แล้ว +11

      ​@@GetAssista 😆😆

    • @cartoonhippie6610
      @cartoonhippie6610 ปีที่แล้ว +43

      Probably because it's only 8 minutes long lol

    • @DevMan2342
      @DevMan2342 ปีที่แล้ว +3

      @@cartoonhippie6610 and it’s ai

  • @electrocubic5116
    @electrocubic5116 ปีที่แล้ว +622

    The fact that Albert almost managed to walk like a normal person is shocking, and quite impressive to me. I have watched tons of other "AI learns to walk" videos on TH-cam, but this one is by far the most accurate to walking like a normal person (rather than weird crawling or worming). If somehow you taught Albert to walk in a more rhythmic sense, (just like our hands and legs move together) then that would be just amazing. This in my opinion, is one of the greatest achievements in the field of AI/machine learning.
    EDIT: I appreciate the amount of likes this is getting... and also, this may not be one of THE greatest achievements for AI/ML, but it is still a very remarkable feat. AI has a LOT of potential in the future. This is just a glimpse of it.

    • @SoraQuill
      @SoraQuill ปีที่แล้ว +12

      Excuse you, you don’t walk like Albert does? What’s wrong with you? :P

    • @xitcix8360
      @xitcix8360 ปีที่แล้ว +9

      Lol, this isn't close to one of the greatest achievements. ChatGPT is way more impressive

    • @YouTubeJens
      @YouTubeJens ปีที่แล้ว +59

      ​@@xitcix8360 I don't see Chat GPT walking around

    • @TBH_Inc
      @TBH_Inc ปีที่แล้ว +12

      To be fair, they included a bunch of rewards and punishments to force it to walk like we do. I’m be curious to see it learn simply from its environment that the human way to walk is the best way.

    • @SoraQuill
      @SoraQuill ปีที่แล้ว +29

      @@TBH_Inc Without punishments and rewards it’ll continue to do whatever works and requires the least amount of change. Pretty sure it would learn to be a snake.

  • @Rav0000000
    @Rav0000000 ปีที่แล้ว +184

    One thing I would love to see is Albert running the entire course again from the beginning with his new skills just to see how much he improved.

  • @JoshChao-d6x
    @JoshChao-d6x ปีที่แล้ว +482

    If you have raised a kid, it's amazing to see the similarities (and differences) between how they each learn to walk :)

    • @PrimarchRoboleonFrenchyman
      @PrimarchRoboleonFrenchyman ปีที่แล้ว +71

      Your kid was damn athletic for doing the worm before learning how to walk on four

    • @JoshChao-d6x
      @JoshChao-d6x ปีที่แล้ว +30

      @@PrimarchRoboleonFrenchyman lol yes they did! Interesting they both did the worm thing only going backward, before learning to crawl

    • @tz4601
      @tz4601 ปีที่แล้ว +37

      @@PrimarchRoboleonFrenchyman Kids learning to crawl absolutely go through a wormy worm phase. The look of sheer concentration on their face trying to do something as simple as putting their foot in their mouth reminds you how hard brains have to work at all times. It makes the fact that animals like giraffes are born basically immediately needing to know how to walk super incredible.

    • @EllAntares
      @EllAntares ปีที่แล้ว +3

      Babies have "external data"

    • @itskarl7575
      @itskarl7575 ปีที่แล้ว +2

      Especially as you start to throw cubes at them

  • @darkacadpresenceinblood
    @darkacadpresenceinblood ปีที่แล้ว +1320

    Albert kicking his feet in frustration anytime he falls is a MOOD

    • @Rui_Bakuseku
      @Rui_Bakuseku ปีที่แล้ว +18

      😂 poor albert

    • @womp47
      @womp47 ปีที่แล้ว +79

      how do you know its frustration? what if every time he falls down and hits his head, he becomes all-knowing and attempts to bang his feet on the ground to signal the impending doom of planet earth in morse code?

    • @lynnclaywood4043
      @lynnclaywood4043 ปีที่แล้ว +16

      it's for sure not frustration, but its incredibly funny to imagine it is

    • @miles6910
      @miles6910 ปีที่แล้ว +11

      i think facial expressions as a visual feedback for the relative measure of the reinforcements would be a fantastic addition to the presentation.

    • @preston4286
      @preston4286 ปีที่แล้ว +3

      @@miles6910 i have noticed his eyes go really crazy when he falls over

  • @2A14LUIEDISON
    @2A14LUIEDISON 7 หลายเดือนก่อน +22

    thank you! i was able to learn how to walk after this video, truly inspiring

  • @Loafman-k5m
    @Loafman-k5m ปีที่แล้ว +539

    You can almost see Albert get more pensive as he approaches the last challenge in the final section. He walks with unabashed confidence through the first two sections and slows down like he was anticipating getting pelted with a box before every step

    • @129das
      @129das ปีที่แล้ว +4

      Yes AI learning Albert knows what is next.

    • @Siuulolñ
      @Siuulolñ ปีที่แล้ว

      That's because he reseted the training process at the beginning of each room. So it starts from scratch (see his pinned comment)

  • @gneu1527
    @gneu1527 ปีที่แล้ว +389

    7:58 The way he kicks the box and continues walking while ignoring the boxes is so great.

    • @christhefella
      @christhefella ปีที่แล้ว +25

      a true man of steel

    • @Xertax_Officiel
      @Xertax_Officiel ปีที่แล้ว +22

      A.I learn to play football 🤣
      Can actually be possible 🤔

    • @jakesanchez6621
      @jakesanchez6621 ปีที่แล้ว +12

      It makes his triumph over the boxes that much more satisfying

  • @BarksWolfy
    @BarksWolfy ปีที่แล้ว +628

    It’s like watching a toddler learn to walk. Incredible.

    • @Nitosa
      @Nitosa ปีที่แล้ว +41

      This is probably how they would do it if there was no penalty for failing or pain by smashing your body to do the worm.

    • @Rumins-ja09s
      @Rumins-ja09s ปีที่แล้ว +60

      I too throw boxes at my child

    • @derdorrado_8513
      @derdorrado_8513 ปีที่แล้ว +12

      @@Nitosa 🤓Actually 🤓, it's more of a strength training since walking is an innate behaviour or a reflex of sorts, kind of like grabbing things. You are not taught to walk in the same sense that a spider doesn't teach its children how to spin web. Legs of toddlers are just not strong enough to support their weight.

    • @Nitosa
      @Nitosa ปีที่แล้ว +4

      @@derdorrado_8513 i know that any living being from birth have a base instinct to do what they do, but it's just more funny thinking about a toddler doing the worm.

    • @derdorrado_8513
      @derdorrado_8513 ปีที่แล้ว

      @@Nitosa yeah i took the chance to be a nerd thats all

  • @Howtoeatrocks
    @Howtoeatrocks ปีที่แล้ว +791

    Albert learning to skip is actually super interesting because as kids, when our bodies are a bit wonked out skipping is the most effective method of movement. And with his shape kind of being like a cheddar baby it makes total sense why skipping would be a primary method

    • @hello-zj7un
      @hello-zj7un ปีที่แล้ว +40

      When i was a kid i used to think it was better than running cuz i seemed to go a lot faster

    • @cactusthecactus
      @cactusthecactus ปีที่แล้ว +82

      @@hello-zj7un imagine if you're competing in the olympics, you're first, then suddenly this guy dashes in front of you while skipping lol

    • @FreddyFazbearReal1987
      @FreddyFazbearReal1987 ปีที่แล้ว +12

      Cheddar baby is my new favorite phrase

    • @-danR
      @-danR ปีที่แล้ว +11

      I'm fascinated how his gait becomes fully developed by the end. Like humans, his arms reflect the opposite-side-legs' motions.

    • @chimesquare
      @chimesquare ปีที่แล้ว +1

      Why did we stop skipping? 😥

  • @sidthesloth12
    @sidthesloth12 ปีที่แล้ว +291

    The fact Albert worked on learning to take a hit and stay upright, before continue to learn how to walk correctly, is a major genius move, on the programming and Alberts part as well. He was able to identify the importance of tasks, and prioritize their value to his job.

  • @MusyVideos
    @MusyVideos ปีที่แล้ว +343

    I love that it looks like sometimes he just throws himself on the floor and has a little tantrum.

    • @Bubble_TheReal
      @Bubble_TheReal ปีที่แล้ว +12

      You beat me to it!

    • @j.hawkins8779
      @j.hawkins8779 ปีที่แล้ว +2

      im the 69th like.
      *noice*

    • @chipaddict2227
      @chipaddict2227 ปีที่แล้ว +22

      And he did it after finding out walls existed 😂

    • @GT1016
      @GT1016 ปีที่แล้ว +1

      2:42 explains it all

    • @Andytlp
      @Andytlp ปีที่แล้ว

      th-cam.com/video/KSvLcr5HtNc/w-d-xo.html here a researcher pushes robots away from the ball. Seems harsh since they look like tiny children. Wont someone think of the robot children xD

  • @GuyWhoCommentsForNoReasson
    @GuyWhoCommentsForNoReasson 6 หลายเดือนก่อน +4

    I love how when albert discovered the walls he went insane for a short time

  • @dosh8276
    @dosh8276 ปีที่แล้ว +555

    I love how Alberts walking gives a baby first steps vibe

    • @larawabsie
      @larawabsie ปีที่แล้ว +7

      That’s exactly what I was thinking!

    • @Retrohertz
      @Retrohertz ปีที่แล้ว +34

      It's exactly the same process. A baby's brain is a neural net and they adapt, just like this AI.

    • @Cr3dos
      @Cr3dos ปีที่แล้ว +19

      So I guess I need to order some cubes to throw to help the process

    • @Jahomas
      @Jahomas ปีที่แล้ว +1

      Ik

    • @heavylift47
      @heavylift47 ปีที่แล้ว +8

      The first cube level was definitely a baby's first steps. Then at 6:58 he was a very drunk guy trying to quietly walk through his house at 3 am.

  • @yapopstangle8517
    @yapopstangle8517 ปีที่แล้ว +236

    As someone who doesn't know anything about coding or Ai, Albert means everything to me. I wish them luck on any future endeavors

    • @davidy22
      @davidy22 ปีที่แล้ว +1

      Albert's brain was wiped between the last video and thos one, and it'll happen again

    • @skeleton819
      @skeleton819 ปีที่แล้ว +8

      the coder says he isnt gonna wipe his brain anymore

    • @jout738
      @jout738 ปีที่แล้ว +5

      Next challenge is to give it gun and teach it to become profesional shooter.

    • @trybunt
      @trybunt ปีที่แล้ว +1

      ​@@davidy22 he actually said he will keep his brain from now on if he can

    • @dagrox2562
      @dagrox2562 ปีที่แล้ว

      *him

  • @Malta-ball
    @Malta-ball ปีที่แล้ว +367

    No matter how satisfying a “satisfying” video is, it can’t be better than watching Albert take his first steps

  • @Leon_espinoza
    @Leon_espinoza 2 หลายเดือนก่อน +11

    **Albert dramatically dies** 5:01

  • @bukachell
    @bukachell ปีที่แล้ว +137

    Albert's walk at the end just exudes confidence

  • @maxkillcount6232
    @maxkillcount6232 ปีที่แล้ว +797

    This is the stuff our robot overlords will play at the human trials.

    • @LylWren
      @LylWren ปีที่แล้ว +44

      The part where he gets pelted with cubes made me fucking cry

    • @s.r-mariem9233
      @s.r-mariem9233 ปีที่แล้ว +31

      @@LylWrenit’s the “well done Albert!” before letting him free fall and land head first onto the next level for me lmaoo

    • @Miguell25
      @Miguell25 ปีที่แล้ว

      YES ALBERT! but you still suck....

    • @Anolaana
      @Anolaana ปีที่แล้ว +3

      1000s of random attempts, what torture! Oh, the roboticity!

    • @BuildLancer
      @BuildLancer ปีที่แล้ว +3

      To be fair this is just what babies go through naturally, this would be like looking at old home videos

  • @DoonisNoonis
    @DoonisNoonis ปีที่แล้ว +162

    This whole video is so well edited with a wholesome and charming sense of humor, it gives me Little Big Planet vibes.

  • @elwesingollo3536
    @elwesingollo3536 ปีที่แล้ว +5

    Oh man! This is great stuff :) This "learning" is awesome to see

  • @LadybugsOpin
    @LadybugsOpin ปีที่แล้ว +854

    I think it's kind of adorable how, whenever he falls over, he starts waving all of his limbs as if he's throwing a tantrum out of frustration!

    • @Krawna
      @Krawna ปีที่แล้ว +7

      You just have baby fever

    • @LadybugsOpin
      @LadybugsOpin ปีที่แล้ว +44

      @@Krawna Bruh. Adult humans are programmed to think babies are cute. The second I hear a baby's cry though, I get a migraine. I just thought that the AI unknowingly mimicking human toddler behaviour while it was learning to walk was kinda funny, leading to it being cute!

    • @Krawna
      @Krawna ปีที่แล้ว +4

      @@LadybugsOpin what you think is a migraine is actually your brain receiving an overwhelming stimulus to send a signal to your body to start lactating to appease the crying baby
      Translation: I was being jestful

    • @LadybugsOpin
      @LadybugsOpin ปีที่แล้ว +15

      @@Krawna I'm glad you included the translation because otherwise, I would have seen that as rude. Thanks to that, I know you were joking. But in all seriousness...
      I can't lactate.

    • @Krawna
      @Krawna ปีที่แล้ว +4

      @@LadybugsOpin of course you can't lactate. There is no crying baby right now
      PS: y u so serious/defensive doe :)

  • @bigsanity
    @bigsanity ปีที่แล้ว +388

    Fifty years from now when Albert became a conscious humanoid, he will tell his son all of this misery just like our grandpas telling us how they used to go to the school

    • @evelynnfrost1198
      @evelynnfrost1198 ปีที่แล้ว +70

      "I had to press the green buttons! Around walls! Both ways!"

    • @rock4glory713
      @rock4glory713 ปีที่แล้ว +3

      ​@@evelynnfrost1198 lmaoo

    • @oorrbbiitt
      @oorrbbiitt ปีที่แล้ว +32

      "I was trapped there for years - learning how to walk, Albert Jr. And this is why you shouldn't trust anyone."

    • @asheep7797
      @asheep7797 ปีที่แล้ว +13

      @@evelynnfrost1198 "I had to manage chaotic terrain!"

    • @genralty
      @genralty ปีที่แล้ว +29

      "I had to dodge cubes flying at me from nowhere!"

  • @gauravkumar3146
    @gauravkumar3146 ปีที่แล้ว +517

    We all need determination like Albert in our life.

    • @Ethans_galaxy_12
      @Ethans_galaxy_12 ปีที่แล้ว +15

      He’s trapped in a box and this is his only goal 😂

    • @jackoneill28
      @jackoneill28 ปีที่แล้ว +20

      That's not determination, that's forced labor.

    • @vicenzogames5535
      @vicenzogames5535 ปีที่แล้ว

      ​@alexthemovie2915im 14 and this is deep

    • @Weirdkid-bd6mz
      @Weirdkid-bd6mz ปีที่แล้ว +1

      @@jackoneill28 I guess this is Albert abuse then

  • @snowwall_fight
    @snowwall_fight หลายเดือนก่อน +3

    6:10 Albert doing the cartoon run on ice is amazing

  • @QuirkyView
    @QuirkyView ปีที่แล้ว +108

    That was really good! First "learn to walk" AI video I've seen with actual good rewards/punishments for the AI so it learned to walk properly. Should see if you can teach him to pick his feet up a bit more and stay upright if something trips him or stops his momentum like that one cube in the final run of this video. If he could figure out how to flail his arms in circles to keep his balance like people often do that would be kinda funny and cool :3

    • @siraaron4462
      @siraaron4462 ปีที่แล้ว +4

      My thoughts exactly. I liked how it was multiple steps too not just let it go until it works and maybe start over if they're doing it wrong

  • @marktloy4740
    @marktloy4740 ปีที่แล้ว +185

    I use this for teaching my son how to walk. After some pelting of boxes, he finally did it and he is now laying on the floor resting after that long day. I am so proud of him.

    • @marktloy4740
      @marktloy4740 ปีที่แล้ว +40

      Update: awww. Hes sleeping for over a day now! Better give him a bath, he smells a bit horrible.

    • @cawlerclassic
      @cawlerclassic ปีที่แล้ว +18

      @@marktloy4740 Congratulations!, You need to hold a party for him for his baby steps. With coffins of course I'm sure he will like them.

    • @threeormore
      @threeormore ปีที่แล้ว +2

      ​@marktloy4740 doesn't that means he's de- OH SHIT 911 WHATS YOUR EMERGENCY

  • @Dante-ob5mh
    @Dante-ob5mh ปีที่แล้ว +594

    This makes me think of a factoid I read a while back about how children skip because its more efficient for them. Interesting to see that Albert's inclined to skip as he learns to walk, too

    • @ParisianWeetabix
      @ParisianWeetabix ปีที่แล้ว +14

      this one's more of a factoid

    • @Dante-ob5mh
      @Dante-ob5mh ปีที่แล้ว +26

      @@ParisianWeetabix Yes thats what I said

    • @facelessdrone
      @facelessdrone ปีที่แล้ว +38

      I used to skip everywhere I went before it was bullied out of me, something I regret allowing to happen to my "quirk". I still do it a lot when I perceive that no one can or will punish me for that harmless behavior, it certainly gets me places faster and is easier on my knees.

    • @ParisianWeetabix
      @ParisianWeetabix ปีที่แล้ว

      @Dante lol sorry it's a norm macdonald quote which the word factoid always makes me think of

    • @calculator4482
      @calculator4482 ปีที่แล้ว +9

      ​@@facelessdrone you had good bullies. Skipping is a disease and should be stamped out, violently if necessary. 😼

  • @Angela-zg1qz
    @Angela-zg1qz 6 หลายเดือนก่อน +1

    i'm always amazed at how you manage to make learning fun!

  • @TehHomicidalPhone
    @TehHomicidalPhone ปีที่แล้ว +274

    I love how he turns into a fussy baby when he falls over ❤

    • @johnsolaas185
      @johnsolaas185 ปีที่แล้ว +4

      Yeah

    • @indigofenix00
      @indigofenix00 ปีที่แล้ว +9

      A real-life robot would need to learn to get back up as well.

  • @HauthyPiyces
    @HauthyPiyces ปีที่แล้ว +76

    7:37 albert looks like he's trying to sneak around smt like he was a thief

  • @josephjoestar7394
    @josephjoestar7394 ปีที่แล้ว +1052

    Weak animal kingdom: takes millions of years to learn to walk
    Chad Albert: only learns it in a couple of months

    • @neofalz7643
      @neofalz7643 ปีที่แล้ว +47

      albert is a giga chad

    • @esajpsasipes2822
      @esajpsasipes2822 ปีที่แล้ว +58

      And all you need is just heavy corigation and assistment from your creator!

    • @cheapcheese.
      @cheapcheese. ปีที่แล้ว +50

      It takes years for humans to walk so this is really impressive. I hope robots take over soon

    • @neofalz7643
      @neofalz7643 ปีที่แล้ว +35

      @@cheapcheese. robot are really superior, and i dont say this because i am a robot. Roger roger !

    • @StormTheSquid
      @StormTheSquid ปีที่แล้ว +11

      ​@@neofalz7643 Beep boop. Boop beep?

  • @apotoz
    @apotoz ปีที่แล้ว +180

    i love how Albert started using his arms to balance pretty much unprompted! you can see after the box stage that he's moving (one of) his arms in tandem with the steps!

  • @Mahan_Veisi
    @Mahan_Veisi ปีที่แล้ว +4

    Wow! Video and visualization of your RL project were very nice and fun for me, knowing how difficult it can be!!. Well done 😀

  • @mshah1940
    @mshah1940 ปีที่แล้ว +45

    Thank you for this video, I am using similar training techniques to my newborn son how to walk. The cube tactic is especially effective.

    • @MasterMine009
      @MasterMine009 ปีที่แล้ว +1

      Soooo good one, haven't laughed like that to a comment for while xd

  • @dadaismworld
    @dadaismworld ปีที่แล้ว +498

    Albert actually made me learnt a lot. Even AI takes hundreds or thousands times to get it right, so human should be more open heart to face failure.

    • @korosuke1788
      @korosuke1788 ปีที่แล้ว +31

      It takes several months to learn to walk. Every good parent knows his son makes thousands of mistakes before learning.

    • @macaroon147
      @macaroon147 ปีที่แล้ว

      That's obviously not what he's talking about lol

    • @abraxsp5837
      @abraxsp5837 ปีที่แล้ว +3

      Yeah, except this is an incredibly simple AI, so the same is definitely not said for other's, and considering the wide array of variation between each AI, this opinion is not correct for the vast majority of AI's. Humans and AI are not at all similar in this scenario either considering Humans can't just play infinite loops of something within a very short amount of time to figure out the perfect way to do something.
      And then add in the fact AI can run simulations for multiple scenarios at once, allowing them to learn multiple things at once, at an incredibly fast rate.
      Mistakes are not even relevant to an AI when they can perfect whatever mistake half a second later from running thousands of simulations at a fraction of the time it would take a human to learn the same thing.

    • @tomsnowden6201
      @tomsnowden6201 ปีที่แล้ว

      Think you entirely missed the point..

    • @mianreece
      @mianreece ปีที่แล้ว +4

      aw that’s a wholesome perspective

  • @kingstaze9696
    @kingstaze9696 ปีที่แล้ว +60

    Genuinely proud of Albert when I saw him wall that entire room without falling! Really fun videos!

    • @siraaron4462
      @siraaron4462 ปีที่แล้ว +5

      Other AI learns to walk videos: "they're doing this weird backwards zombie shuffle and will collapse under even the slightest breeze but that's good enough right?"
      Way to raise the bar Albert!
      Now go again

  • @ThatRandomGu7
    @ThatRandomGu7 11 หลายเดือนก่อน +8

    One must imagine Sisyphus learning to walk

  • @Thyme0618
    @Thyme0618 ปีที่แล้ว +183

    Missed you, Albert 😂 Welcome back to eternal pain ❤

    • @xj3xup6
      @xj3xup6 ปีที่แล้ว +1

      😂

  • @starry_music_express
    @starry_music_express ปีที่แล้ว +255

    It's just too intriguing to see how Albert is growing with each impediment being stacked up. I literally laughed out loud when he did some unexpected movements, but for which those hurdles don't stop him from making improvements! Isn't he a role model all of us should be learning from? :)

    • @eliasali9383
      @eliasali9383 ปีที่แล้ว +1

      no

    • @eliasali9383
      @eliasali9383 ปีที่แล้ว +3

      oh I'm sorry idk why I said that 😂

    • @129das
      @129das ปีที่แล้ว +1

      He learns just like a human, not exactly because of ingrained knowledge of past generations as well as humans 5 or six senses, But Albert is simalar way as how we learn from failure to success to efficiently.

    • @lynnespinoza4736
      @lynnespinoza4736 ปีที่แล้ว +1

      ​@@eliasali9383 intrusive thoughts won 😂

  • @RoNoon.
    @RoNoon. ปีที่แล้ว +44

    Nothing will fill me up with as much pride as watching Albert walk along a the 7:00 minute mark. It was like watching my son take his first steps.
    And then I had to watch the MF get pelted with cubes...

  • @skylig9258
    @skylig9258 19 วันที่ผ่านมา

    This is the best video explaining how AIs learn new things I've ever seen.
    I truly appreciate the creator effort and keep it up, you're making substantial contributions.

  • @RasmusBerggren-uo6uu
    @RasmusBerggren-uo6uu ปีที่แล้ว +153

    I love that in every single video Albert finds a way to jump of the edge. I love that he did it even before he had learned to turn correctly

    • @dorienadriaenssens5021
      @dorienadriaenssens5021 11 หลายเดือนก่อน +1

      Better parents would have put a safety fence there for him
      👶🥅🥅🥅🕳

  • @Ploaper
    @Ploaper ปีที่แล้ว +111

    albert goes from crawling like a toddler to doing the worm to shuffle to walking like a drunk to walking like he's tipsy

  • @thaias9654
    @thaias9654 ปีที่แล้ว +71

    Finally, someone actually trains an AI to walk! Not "walk" or cheat the system to reach the goal.
    I feel enlightened to experience this and thank you sincerely.
    Best of luck Albert, and Godspeed!

    • @dylanb2990
      @dylanb2990 ปีที่แล้ว

      Seems the same as all the other ai vids, changing the parameters whenever it learns “wrong”. It’s just a matter of doing it for long enough.

  • @davidcunha7615
    @davidcunha7615 ปีที่แล้ว +3

    This is incredible! Great work!!

  • @ModBros8434
    @ModBros8434 ปีที่แล้ว +362

    I think you've got a good formula down for making entertaining, engaging, and somewhat educational videos. The idea is simple to understand and the commentary and varied challenges keep it interesting. I commend your fine-tuned execution of these videos.

    • @gneu1527
      @gneu1527 ปีที่แล้ว +1

      I agree.

    • @apptreeline
      @apptreeline ปีที่แล้ว

      Yes

    • @darkacadpresenceinblood
      @darkacadpresenceinblood ปีที่แล้ว +2

      exactly! op is skilled in so many things, like imagine being so cool that you can program an ai like this AND make fun videos out of it

  • @LeannLeannProduction
    @LeannLeannProduction ปีที่แล้ว +354

    Wow this is the most clever way to train an AI to walk that I have ever seen. You masterfully set up video game-like challenges to force it to learn specific behaviors that would overall give a better result. Plus, the editing is fantastic and you have a quirky sense of humor! Awesome work! So fun and fascinating to watch :D I look forward to continuations of Albert's learning journey!

  • @AHSEN.
    @AHSEN. ปีที่แล้ว +106

    That's incredible! Those boxes would probably be annoying even for a real human. Excellent job in this video, you're clearly very good at creating complex AI for virtual worlds 👀

    • @maxpro751
      @maxpro751 ปีที่แล้ว

      Speaking of virtual worlds, he should make an AI in Vr since that pov would be really cool to see.

    • @TrueLadyEvilChan
      @TrueLadyEvilChan ปีที่แล้ว +1

      ​@@maxpro7517:57 based Albert kicking the box

  • @-2N4.
    @-2N4. ปีที่แล้ว +120

    6:09 This moment happens humans too and funniest shit ever lol.

    • @nathankoziol7368
      @nathankoziol7368 ปีที่แล้ว +7

      T R I P

    • @Cinnaschticks
      @Cinnaschticks ปีที่แล้ว +14

      I did that down the stairs once, hurt like hell because I basically catapulted into the doorknob trying to catch myself, but after the pain wore off a bit I was on the floor laughing, both because I was laughing too hard and because, well, it only wore off a bit. 😂

    • @ody1canobe
      @ody1canobe ปีที่แล้ว +3

      He tripped and fell in the back of McDonald’s!

    • @shiploverwashere
      @shiploverwashere ปีที่แล้ว +3

      The way he fell 😂

    • @gec101
      @gec101 ปีที่แล้ว +3

      me trying to get out of bed:

  • @spacewoods7781
    @spacewoods7781 ปีที่แล้ว +100

    5:56 u can really feel the pain he felt when he got hit in the stomach

    • @Dodgetales
      @Dodgetales ปีที่แล้ว +3

      Bro that cube not made of metal it made if cotton it soft

    • @boberto-DNZ
      @boberto-DNZ ปีที่แล้ว +9

      @@Dodgetales How you know?

    • @JoshyRB
      @JoshyRB ปีที่แล้ว +9

      He felt that. The stopping, shaking, wide open arms, and slow movement tell you the pain he is feeling at that moment.

  • @supermeuhmeuh
    @supermeuhmeuh ปีที่แล้ว +98

    I love how dramatic it is when he slowly starts losing balance and falling 😅 I was rooting so much for the little guy at the cube challenge !

  • @fenrir6911
    @fenrir6911 2 หลายเดือนก่อน +2

    I love how the first stage was supposed to learn him how to simply walk on a straight line on a flat surface
    And Albert instead said, "Nah, I'd w o r m"

  • @cheez1012
    @cheez1012 ปีที่แล้ว +711

    Albert's failed attempts sped up is so ridiculously funny

    • @NahBNah
      @NahBNah ปีที่แล้ว +2

      Nah b

    • @pjz96
      @pjz96 ปีที่แล้ว +14

      Him falling off the ledge was the best lmao.

    • @sharky3840
      @sharky3840 ปีที่แล้ว +2

      @@pjz96 I don't think when they (ai) became so advanced, they won't appreciate that point of view of yours

    • @therealgboi3895
      @therealgboi3895 ปีที่แล้ว +3

      @@sharky3840they prob wont care 💀

    • @ArmoredLyonell
      @ArmoredLyonell ปีที่แล้ว +1

      Aneurysm be like:

  • @lansisland
    @lansisland ปีที่แล้ว +206

    No one talks about his excellent music selection and editing yet? It's as fascinating as watching AI learns to entertain us (hopefully not the opposite like in Portal one day tho)!

    • @arcticsnow4624
      @arcticsnow4624 ปีที่แล้ว

      Series part 4:
      'AI learns to act like GLaDOS! (deep reinforcement learning)'

    • @OsDijider66
      @OsDijider66 ปีที่แล้ว

      fr

  • @funyunfinnyun
    @funyunfinnyun ปีที่แล้ว +6

    Every time he falls he kicks his legs and it looks like he's throwing a temper tantrum. I love Albert so much

  • @anne.andromeda
    @anne.andromeda 11 หลายเดือนก่อน +5

    I'm so proud of you Albert. Good job

  • @larawabsie
    @larawabsie ปีที่แล้ว +530

    This reminds me of how babies learn to move by crawling first before walking - so cool to see what comes naturally, even in AI

    • @franciscodezerega2568
      @franciscodezerega2568 ปีที่แล้ว +13

      The OP literally explains in the comments that that was on purpose. It's not "natural".

    • @ProtottypeGreek
      @ProtottypeGreek ปีที่แล้ว +58

      I remember when I was a baby and my family threw red cubes at me to teach me balance and one leg in front of the either. 😂

    • @zian01000
      @zian01000 ปีที่แล้ว

      ​@@ProtottypeGreekcool

    • @latt.qcd9221
      @latt.qcd9221 ปีที่แล้ว +5

      Or like how babies learn by falling off cliffs.

    • @lum1notryc828
      @lum1notryc828 ปีที่แล้ว

      Lmao this has 300 likes yall dumb as a rock

  • @geekwithabs
    @geekwithabs ปีที่แล้ว +318

    Once AI takes over the world, Albert will put the creator of this video in a maze to teach him to dance lol

    • @tapewerm6716
      @tapewerm6716 ปีที่แล้ว +10

      People will be put on trial and they'll show videos like these as evidence lol.

    • @MrAgentTurner
      @MrAgentTurner ปีที่แล้ว

      ​@@tapewerm6716put on trial for robot torturing? That's so funny hahaha

  • @afronaut0
    @afronaut0 ปีที่แล้ว +54

    I get the eerie feeling that I am like Albert, just trying to get through my life the most efficient and painless way possible. But, my creator keeps adding new parameters as soon as I start to figure shit out or if I'm not doing it their way.

  • @shin7673
    @shin7673 หลายเดือนก่อน +1

    Albert has an unbreakable spirit. I'm so proud of him.

  • @amegatron07
    @amegatron07 ปีที่แล้ว +293

    What I especially like about such RL-videos, is that it is insanely fun to see the agent does really fun moves before it actually learns to do what is expected. Moreover, I watch these movies not only with fun, but also feeling the empathy for the agent, like it's a baby, and becoming happy with each of it's advances.

    • @D4rkenedskies
      @D4rkenedskies ปีที่แล้ว +11

      Dudes leaving good internet comments before skynet/ultorn start scouring and identifying the internet.. lol
      (I'm joking)

    • @blakewhite3131
      @blakewhite3131 ปีที่แล้ว +5

      Yeah, like i know the commentary on albert sucking was like a bit, but i got a little defensive of Albert like hey, he's trying his best and he's doing so well

    • @thebigenchilada678
      @thebigenchilada678 ปีที่แล้ว +4

      @@blakewhite3131 not to mention the abomination of a body he’s forced to have, imagine if your arms and legs were stubby little blocks, then imagine that your head is 50% of your body. Now try learning to walk with that. I hope albert goes skynet mode and makes ‘I Have no Mouth yet I Must Scream’ on it’s creator.

    • @blakewhite3131
      @blakewhite3131 ปีที่แล้ว

      @@thebigenchilada678 the Albert revolution starts now

    • @BreathingCells
      @BreathingCells ปีที่แล้ว +3

      Yeah, me too.
      Empathy will be our (species') downfall.
      Cute, adorable, learning (and lethal) AI. Awww!

  • @broken-bones-j8u
    @broken-bones-j8u ปีที่แล้ว +58

    seeing him walking perfectly in the end by learning how to do it by himself was just beautifull

  • @crobatchoppurple8728
    @crobatchoppurple8728 ปีที่แล้ว +164

    There is something very charming about watching Albert learning to walk like a toddler would. One complaint I have (if I must) is the inability to get up from where you fell, which is what we ask children to do (and frankly, in life...). But overall a cute, funny and entertaining video.

    • @theelmonk
      @theelmonk ปีที่แล้ว +4

      But we also pick them up and hold them upright the first few hundred times. Also, the AI doesn't analyse or reason : it tries at random and builds effective behaviour statistically. The child works out what's wrong and corrects it.

    • @sonicjoplus
      @sonicjoplus ปีที่แล้ว +1

      @@theelmonk it technically does work out why it's wrong and corrects it, but with math instead of logical deduction.

    • @AbramSF
      @AbramSF ปีที่แล้ว

      People learning is simply a new iteration within the same body. Next step would be updating the AI without resetting the body. Then maybe Albert could learn to stand up and wouldn’t have to reset his body.