MariFlow - Self-Driving Mario Kart w/Recurrent Neural Network

แชร์
ฝัง
  • เผยแพร่เมื่อ 4 พ.ย. 2017
  • I trained a recurrent neural network to play Mario Kart human-style.
    MariFlow Manual & Download: docs.google.com/document/d/1p...
    Mushroom Cup: / 183296063
    Flower Cup: / 183296268
    Star Cup: / 183296400
    SethBling Twitter: / sethbling
    SethBling Twitch: / sethbling
    SethBling Facebook: / sethbling
    SethBling Website: sethbling.com
    SethBling Shirts: sethbling.spreadshirt.com
    Suggest Ideas: / sethblingsuggestions
    Music at the end is Cipher by Kevin MacLeod
  • เกม

ความคิดเห็น • 723

  • @purplebootsgames
    @purplebootsgames 6 ปีที่แล้ว +561

    Seth is trying to create a brain clone of himself so he can never really die.

    • @julianw7097
      @julianw7097 6 ปีที่แล้ว +23

      +purplebootsgames I'd have this at my funeral as free merchandise for fans of my brain.

    • @Odima16
      @Odima16 6 ปีที่แล้ว +83

      Welcome back, SethBling Reincarnation #4 here

    • @muskit_
      @muskit_ 6 ปีที่แล้ว +14

      SethDOS

    • @espalorp3286
      @espalorp3286 6 ปีที่แล้ว +18

      One day you will be able to race Seth even though he's deader than a doornail

    • @espalorp3286
      @espalorp3286 6 ปีที่แล้ว +6

      *THE RIDE NEVER ENDS*

  • @mushroomtaco9992
    @mushroomtaco9992 6 ปีที่แล้ว +436

    "What is my purpose?"
    "You try to mimick how I play in Mario Kart"
    "...Oh my god"

    • @Private27281
      @Private27281 6 ปีที่แล้ว +3

      mushroom taco lol

    • @Sylfa
      @Sylfa 6 ปีที่แล้ว +3

      Poor lil' robot

    • @albertoguijarro9290
      @albertoguijarro9290 6 ปีที่แล้ว +3

      That is why machines rose against mankind xD

    • @esra_erimez
      @esra_erimez 6 ปีที่แล้ว +9

      mushroom taco That is a whole hack of a lot better than serving butter.

    • @jessiejanson1528
      @jessiejanson1528 6 ปีที่แล้ว +1

      IM PICKLE RIIICK!!!!

  • @themodernshoe2466
    @themodernshoe2466 6 ปีที่แล้ว +289

    A year ago I watched your MarI/O video and was exposed for the first time to neural networks. It was because of watching that video that I decided to take machine learning courses at my college. I am now pursuing a career in AI. Thanks so much!

    • @dsmyify
      @dsmyify 6 ปีที่แล้ว +5

      The Modern Shoe ~ 👍

    • @Scerab
      @Scerab 5 ปีที่แล้ว +1

      Similar story for me. I was focused on game design but I am switching courses around now to fit a machine learning path.

    • @Loading-tr7yv
      @Loading-tr7yv 5 ปีที่แล้ว

      Rory Williams Wow, I am doing that too

  • @PenisGabber
    @PenisGabber 6 ปีที่แล้ว +342

    Quick! Someone train it on TAS data!

    • @Private27281
      @Private27281 6 ปีที่แล้ว +1

      Kitty40 lol

    • @Giranite
      @Giranite 6 ปีที่แล้ว +5

      Whats TAS

    • @MarioManTV
      @MarioManTV 6 ปีที่แล้ว +77

      Kitty40 you'd think it would work well, but in reality, it would be even more prone to getting confused when seeing unfamiliar situations.

    • @fejfo6559
      @fejfo6559 6 ปีที่แล้ว +28

      It would just memorize almost the entire tas perfectly, RNN's are very powerful structures.

    • @djpain
      @djpain 6 ปีที่แล้ว +8

      actually I was going to start working on something like this. I'm going to target SMB3 and see what it can learn.

  • @LazerLord10
    @LazerLord10 6 ปีที่แล้ว +468

    If you're interested in learning more about neural networks, I highly recommend looking up "3blue1brown" on youtube and watching his videos about neural networks. It made my understanding of neural networks go way up!

    • @purplegill10
      @purplegill10 6 ปีที่แล้ว +2

      Thanks for the recommendation!

    • @masheroz
      @masheroz 6 ปีที่แล้ว

      LazerLord10 we

    • @HerbaMachina
      @HerbaMachina 6 ปีที่แล้ว

      Same, I was just about to come down here and make my own comment suggesting the same thing.

    • @mappleo3173
      @mappleo3173 6 ปีที่แล้ว +6

      For more interesting projects using neural networks I also recommend carykh

    • @notquiteordinary
      @notquiteordinary 6 ปีที่แล้ว

      LazerLord10 thanks

  • @kodylima
    @kodylima 5 ปีที่แล้ว +37

    @ 3:42
    "I recorded 15 hours of training data."
    Otherwise known as playing the game. xD

    • @sontapaa11jokulainen94
      @sontapaa11jokulainen94 3 ปีที่แล้ว

      Gotta give props to him for having the patience to play a relatively boring game for 15 h.

    • @thisflyingpotato4227
      @thisflyingpotato4227 3 ปีที่แล้ว +1

      @@sontapaa11jokulainen94 Can be done in small increments, say 20min one day and 2h the next day maybe 30min the 3rd day etc

    • @sontapaa11jokulainen94
      @sontapaa11jokulainen94 3 ปีที่แล้ว

      @@thisflyingpotato4227 yeah but still playing 15 h of some crappy (for todays standards) racing game is hella boring

  • @dominicdabalam1466
    @dominicdabalam1466 6 ปีที่แล้ว +544

    ... and behind this is a bunch of command blocks!

    • @Possseidon
      @Possseidon 6 ปีที่แล้ว +56

      Don't forget about the armorstands

    • @yeem_lad
      @yeem_lad 6 ปีที่แล้ว +9

      kek he doesnt do minecraft anymore though

    • @FreeCpRareAccounts1
      @FreeCpRareAccounts1 6 ปีที่แล้ว +16

      and behind _that_ is an original joke

    • @pumpkin6429
      @pumpkin6429 6 ปีที่แล้ว +1

      Behind your comment is where you'll find a mountain of salt.

    • @brathering_tv
      @brathering_tv 6 ปีที่แล้ว +1

      Minecraftfan4 hes still having a Redstone channel picture though...

  • @giantneuralnetwork
    @giantneuralnetwork 6 ปีที่แล้ว +632

    Wow, the trade off play idea was pure genius! Did you set it up so you could override the networks commands at any time, or have control alternate back and forth at a regular interval? I love the idea of taking control and guiding the network, like you're a master painter guiding the hand of your apprentice...... so sick!! Amazing work!

    • @SethBling
      @SethBling  6 ปีที่แล้ว +243

      I just had it switching at slightly random time intervals, because I didn't trust my reaction time to be fast enough to correct the errors as quickly as I wanted. So I was just always pressing the correct buttons, whether or not I had control (even though it was only recording my button presses when I was in control).

    • @no-fd6mt
      @no-fd6mt 6 ปีที่แล้ว +20

      +SethBling I have no idea what either of you said but ok

    • @BiscuitAWitch
      @BiscuitAWitch 6 ปีที่แล้ว +9

      They're talking about 4:27.

    • @ProGamer1515
      @ProGamer1515 6 ปีที่แล้ว +10

      SethBling Nice! So, have you ever considered DefCon? Your content could be very interesting over there.

    • @tebasak1
      @tebasak1 6 ปีที่แล้ว +3

      SethBling I thought that you had programmed it to relinquish inputting command when it detected input from an external controller

  • @HenrikoMagnifico
    @HenrikoMagnifico 6 ปีที่แล้ว +649

    *Dope*

    • @invschematics
      @invschematics 6 ปีที่แล้ว +5

      *_Nope_*

    • @Oddzoff
      @Oddzoff 5 ปีที่แล้ว

      666 likes original

  • @EnomGG
    @EnomGG 6 ปีที่แล้ว +3

    I've been wanting to get into neural networking just recently so a refresher video of you demonstrating some of the cool things we can do is an awesome inspiration! :D

  • @SpektralJo
    @SpektralJo 6 ปีที่แล้ว +457

    Good that I watched the 3blue1brown videos so I understood something!

    • @lorrdy7640
      @lorrdy7640 6 ปีที่แล้ว +2

      SpektralJo thx

    • @davidb5205
      @davidb5205 6 ปีที่แล้ว +19

      Same! I was like, "I actually know some of these words and the math behind it"

    • @redsalmon9966
      @redsalmon9966 6 ปีที่แล้ว +6

      Oh also the sigmoid, weight, layers, etc.

    • @sthealhawk
      @sthealhawk 6 ปีที่แล้ว +2

      O sht a bro

    • @Aguacommander
      @Aguacommander 6 ปีที่แล้ว +2

      Same

  • @laserfloyd
    @laserfloyd 6 ปีที่แล้ว +16

    I'd be interested to see how it would react to a speed runner training it.

  • @HankW
    @HankW 6 ปีที่แล้ว +148

    You should probably get a github page going if you want to share source code? Much better interface than google docs :)

    • @fireboltofdeath
      @fireboltofdeath 5 ปีที่แล้ว +5

      +orochimarujes
      You should probably take a common sense lesson?

  • @SpacePrez
    @SpacePrez 6 ปีที่แล้ว +1

    Love it. Keep up the good work SethBling!

  • @IllIlIIIIIIIllIlI
    @IllIlIIIIIIIllIlI 6 ปีที่แล้ว +18

    Finally!!! More neural network videos! Keep it up SethBling, I love this stuff!

    • @giantneuralnetwork
      @giantneuralnetwork 6 ปีที่แล้ว

      Miguel Ballard Agreed! Nothing I find more interesting really... you can apply them to an endless amount of problems!

  • @Snowpanel
    @Snowpanel 6 ปีที่แล้ว +1

    Currently learning neural networks, and this is gold. Thank you !

  • @zacpier
    @zacpier 6 ปีที่แล้ว +1

    this stuff is so incredibly cool! I love these videos!

  • @scares009
    @scares009 6 ปีที่แล้ว

    So glad you finally released the video on this!

  • @benperschall6648
    @benperschall6648 6 ปีที่แล้ว +12

    These neural network videos are so good. Please make more!

  • @rajkhattar2830
    @rajkhattar2830 6 ปีที่แล้ว +1

    That idea to switch between NN and yourself was pretty clever . I'm often impressed by your creativity man !

  • @Automatik234
    @Automatik234 6 ปีที่แล้ว

    Your projects are so cool!

  • @607
    @607 6 ปีที่แล้ว

    Cipher

  • @christianryan1529
    @christianryan1529 5 ปีที่แล้ว

    So cool man! Great work!

  • @mikew4790
    @mikew4790 6 ปีที่แล้ว

    Brilliant, as always. Thanks Seth.

  • @GretgorPooper
    @GretgorPooper 6 ปีที่แล้ว

    Oh my, man, I love your neural network videos

  • @tbx1024
    @tbx1024 6 ปีที่แล้ว

    This is amazing. Well done!

  • @Vampier
    @Vampier 6 ปีที่แล้ว

    it was fun watching the videos in the background while I was working

  • @mugsrootbeer1
    @mugsrootbeer1 6 ปีที่แล้ว +2

    This is very cool! If you are looking for something pretty simple to try and tweak this with, adding convolutional layers prior to your LSTM layers seems tailor-made for this type of application. Chase those gold cups :)

  • @Arcadia000
    @Arcadia000 6 ปีที่แล้ว

    This is freaking awesome! Subbed!

  • @starkaat
    @starkaat 6 ปีที่แล้ว

    As always this is so, so cool. lov u Seth. 👍

  • @l-l
    @l-l 6 ปีที่แล้ว

    I love your content to bits.

  • @AlexBMJ01
    @AlexBMJ01 6 ปีที่แล้ว

    Amazing! Keep up the great work.

  • @lukemoll2521
    @lukemoll2521 6 ปีที่แล้ว

    Thank you Seth - this is a brilliant introduction to NNs!

  • @nowayfortnite4780
    @nowayfortnite4780 6 ปีที่แล้ว

    Really good, I'm personally working on a number recognizer so yeah, good video!

  • @TheMrgeefunker
    @TheMrgeefunker 6 ปีที่แล้ว +4

    I wonder how good it could get watching TAS runs

  • @camiloandresmaciasvargas6556
    @camiloandresmaciasvargas6556 6 ปีที่แล้ว

    Starting to find inspiration to get into this AI and Machine learning world. Awesome! Thanks for sharing!

  • @Gaustos
    @Gaustos 6 ปีที่แล้ว

    Great work on the Skynet-Basics ! Keep on with your work

  • @zachskaer6401
    @zachskaer6401 3 ปีที่แล้ว

    Professor just used this video in our class, super cool stuff.

  • @Vince7778
    @Vince7778 6 ปีที่แล้ว

    yesss another seth video

  • @dduude87
    @dduude87 6 ปีที่แล้ว

    nailed the guess. i was staring ay the bottom left quadrant of gameplay from the start.

  • @gammaf8896
    @gammaf8896 6 ปีที่แล้ว

    This channel has had such a weird progression over the years. I love it

  • @Tony770jr
    @Tony770jr 6 ปีที่แล้ว

    Very cool, just subscribed!

  • @ma271
    @ma271 6 ปีที่แล้ว

    Great video and great job!!!

  • @GlassEyeGaming
    @GlassEyeGaming 5 ปีที่แล้ว

    Great stuff!

  • @AllSab18
    @AllSab18 5 ปีที่แล้ว +1

    I have no idea what's going on, but I'm thoroughly entertained

  • @ralfschmelcher9673
    @ralfschmelcher9673 6 ปีที่แล้ว

    This was a great explanation! In case you want a more detailed version, 3Blue1Brown currently has a great series on that.

  • @FiniteEight
    @FiniteEight 6 ปีที่แล้ว

    That is some seriously impressive stuff.

  • @miconia
    @miconia 6 ปีที่แล้ว

    The man is back on TH-cam!

  • @JordanLui
    @JordanLui 6 ปีที่แล้ว

    Amazing! Thanks for sharing

  • @Ziggy405
    @Ziggy405 5 ปีที่แล้ว

    Super cool video!!

  • @underpowerjet
    @underpowerjet 6 ปีที่แล้ว

    As someone who just started learning Tensorflow. This is awesome!

  • @lunchbox997
    @lunchbox997 6 ปีที่แล้ว

    Jesus fucking christ dude, every video I see of yours is amazing. Love how smart you are my bro, keep up the good work.

  • @Hwangssss
    @Hwangssss 6 ปีที่แล้ว

    Your idea is awesome.

  • @namenamename390
    @namenamename390 6 ปีที่แล้ว +35

    Combine the two systems... I think that would be interesting...

    • @MinerMovie
      @MinerMovie 6 ปีที่แล้ว +1

      Thats what i was thinking too!

    • @percyvile
      @percyvile 6 ปีที่แล้ว

      Easier said than done

    • @revimfadli4666
      @revimfadli4666 6 ปีที่แล้ว

      You mean an LSTM(variant) "trained" via NEAT? That's a good idea that's sadly rarely done

    • @skierpage
      @skierpage 6 ปีที่แล้ว

      Yes, why 200 neurons in 2 levels? Is that more than enough raw brain material that learning can take place, or can it be optimized further.

  • @TheHiroo17
    @TheHiroo17 6 ปีที่แล้ว +4

    Lol you got me with Mr. Electric Mars.

  • @malirk
    @malirk 6 ปีที่แล้ว

    One word - *Astounding*

  • @kikamonju
    @kikamonju 6 ปีที่แล้ว +1

    I am now enamored with the idea of having a tournament where everyone brings their own trained AI and then they compete.
    It'd be like an Amiibo tournament in SSB4, but for the Super Nintendo.

  • @MrAcuriteOf1337
    @MrAcuriteOf1337 2 ปีที่แล้ว

    This video legitimately scooped a paper by a professor I was working with. "HG Dagger" uses the same idea of having a human take over control of an agent, and was published a year after this video

  • @FC-mv4hy
    @FC-mv4hy 6 ปีที่แล้ว +6

    I got the notification for this video as I opened youtube.
    GG

  • @hiimBawb
    @hiimBawb 6 ปีที่แล้ว

    Amazing. As someone who just entered the world of Machine Learning, this video motivates me to become better and better at ML until I am also capable of creating NNs that can perform tasks like this.

  • @zekeluther
    @zekeluther 6 ปีที่แล้ว

    lova ya work bro !

  • @albertoguijarro9290
    @albertoguijarro9290 6 ปีที่แล้ว

    Amazing mate

  • @MrNegaBlox
    @MrNegaBlox 6 ปีที่แล้ว

    so last year. I did an essay for school on using neural networks for self-driving AI. and it failed miserably. both types of networks failed to go through a basic obstacle course. Spent a month's worth of time coding.
    Now I found that every major organization + Sethbling have done it and they make it look easy.

  • @baseballjustin5
    @baseballjustin5 6 ปีที่แล้ว

    This is actually what I was wandering

  • @PseudoMystic
    @PseudoMystic 5 ปีที่แล้ว

    Very cool, makes me think of markov chains and cybernetic feedback.

  • @tarquinnff3
    @tarquinnff3 6 ปีที่แล้ว

    And here I am just watching TH-cam videos. I ain't even mad. Good job. :D

  • @StormageddonTMS
    @StormageddonTMS 6 ปีที่แล้ว

    man that was so mind boggling

  • @diegator
    @diegator 6 ปีที่แล้ว

    Thanks for the more in explanation!!!

  • @xera5196
    @xera5196 6 ปีที่แล้ว

    This sounds like a class project

  • @dudibs1
    @dudibs1 6 ปีที่แล้ว

    very nice! I am impressed.

  • @DaveChips
    @DaveChips 6 ปีที่แล้ว

    This brilliant!

  • @ga6257
    @ga6257 6 ปีที่แล้ว +2

    Self driving cars are also the future of video games

  • @misugijun
    @misugijun 6 ปีที่แล้ว

    Dude this is epic

  • @scoutclover9572
    @scoutclover9572 6 ปีที่แล้ว +1

    0:57 I knew it. I put my finger to the screen when I saw him skid around like that.

  • @jansenart0
    @jansenart0 6 ปีที่แล้ว

    This is the ultimate turing test!!

  • @user-jc4lt1vk2g
    @user-jc4lt1vk2g 5 ปีที่แล้ว

    I just love SethBling's neutral voice xD

  • @galaxycat2653
    @galaxycat2653 6 ปีที่แล้ว +3

    Wow..... mind BLOWN 💣

  • @QuippersUnited
    @QuippersUnited 6 ปีที่แล้ว

    Oh man, I've worked with neural networks and classification with statistical information before. Seeing stuff like this make me feel like my experience is equivalent to handing a monkey a picture of a corvette and expecting him to assemble one.

  • @markitovtr1
    @markitovtr1 6 ปีที่แล้ว

    Just like giant_neural_network pointed out, I had to comment about the geniality of the trade off play. Amazing idea!

  • @sandwich2473
    @sandwich2473 6 ปีที่แล้ว +27

    Would be cool if we could get more interesting AI in games, using tech like this.

    • @sofia.eris.bauhaus
      @sofia.eris.bauhaus 6 ปีที่แล้ว +9

      play against a bot that is trained by your own style of playing, that would be pretty awesome. :)

    • @Zekromaster
      @Zekromaster 6 ปีที่แล้ว +6

      Imagine training a RNN to fight enemies like you do for a whole JRPG.
      Then surprise, there's a secret dungeon where you enemy is a "clone" of your playstyle.

    • @sandwich2473
      @sandwich2473 6 ปีที่แล้ว +1

      That would be beyond amazing.

  • @martiddy
    @martiddy 6 ปีที่แล้ว

    I like how this channel went from Minecraft videos to neural networks videos

  • @Maxix423
    @Maxix423 6 ปีที่แล้ว

    Being in calculus now your videos make sm more sense

  • @romannoodles5856
    @romannoodles5856 6 ปีที่แล้ว

    Great idea!

  • @recessiv3
    @recessiv3 6 ปีที่แล้ว

    In feed forward the inputs are actual between 0 and 1 in most cases, to fit in with the sigmoids in the later layers :)

  • @invisi.
    @invisi. 6 ปีที่แล้ว

    These videos are great ^-^

  • @karlxu1548
    @karlxu1548 6 ปีที่แล้ว

    Tried the last MariIO. That was the best open source ML project I had tried on.

  • @arthur_paulino
    @arthur_paulino 6 ปีที่แล้ว

    amazing!
    i bet the best part was actually playing and recording your gameplay.

  • @galahad6300
    @galahad6300 6 ปีที่แล้ว

    So instead of learning from itself MariFlow learns from you? Neat

  • @jordanc.m.6735
    @jordanc.m.6735 6 ปีที่แล้ว

    Definitely the best Minecraft youtuber out there

  • @macoud12
    @macoud12 6 ปีที่แล้ว +83

    Google DeepMind has AlphaGo
    Elon Musk has OpenAI
    SethBling has MariFlow and MarI/O

    • @Abdullahjimmy
      @Abdullahjimmy 6 ปีที่แล้ว

      Connor smart

    • @trevorjamesconsideracion1982
      @trevorjamesconsideracion1982 6 ปีที่แล้ว +5

      *google deepmind has alphazero.
      They now have AI for chess too and it beat Stockfish 20+ times (Stockfish is one of the strongest engine on chess, rated 3300+)

    • @MackTheTemp1
      @MackTheTemp1 6 ปีที่แล้ว

      leela zero is an open source version around 2400~ you can play

    • @blb
      @blb 5 ปีที่แล้ว +1

      *Elon Musk has left the chat*

  • @popai430
    @popai430 6 ปีที่แล้ว

    0:11 BEST joke ever, you got my like bro !

  • @Cuumerr
    @Cuumerr 6 ปีที่แล้ว +8

    How much armor stands did it take

  • @momoe7563
    @momoe7563 6 ปีที่แล้ว

    Great Video

  • @victoredenmusic5554
    @victoredenmusic5554 6 ปีที่แล้ว

    This is sick

  • @elliottave46
    @elliottave46 6 ปีที่แล้ว

    Seth is a genius

  • @Shours
    @Shours 6 ปีที่แล้ว +8

    *Buddon intensifies*

  • @JetEriksen
    @JetEriksen 5 ปีที่แล้ว

    We seriously need a neural network mario kart tournament.

  • @michaeletzel4877
    @michaeletzel4877 6 ปีที่แล้ว +1

    Did you consider using a generative adversarial network to generate more training data for the RNN? It would be interesting to compare the effect of that on the performance to the effect of using your trade off play idea.

  • @Brenna_stubbs
    @Brenna_stubbs 6 ปีที่แล้ว

    Thank for making this open source

  • @btarg1
    @btarg1 6 ปีที่แล้ว

    Holy fuck, what next, fully functioning Hal 9000 and GLaDOS? Seth, you're just making the world 1 step closer to being overtaken by robots, LOL. Loving these projects, keep up the good work! You need a patreon