MarI/O - Machine Learning for Video Games
ฝัง
- เผยแพร่เมื่อ 12 มิ.ย. 2015
- MarI/O is a program made of neural networks and genetic algorithms that kicks butt at Super Mario World.
Source Code: pastebin.com/ZZmSNaHX
"NEAT" Paper: nn.cs.utexas.edu/downloads/pap...
Some relevant Wikipedia links:
en.wikipedia.org/wiki/Neuroev...
en.wikipedia.org/wiki/Evoluti...
en.wikipedia.org/wiki/Artific...
BizHawk Emulator: tasvideos.org/BizHawk.html
SethBling Twitter: / sethbling
SethBling Twitch: / sethbling
SethBling Facebook: / sethbling
SethBling Website: sethbling.com
SethBling Shirts: sethbling.spreadshirt.com
Suggest Ideas: / sethblingsuggestions
Music at the end is Cipher by Kevin MacLeod - เกม
That is downright fascinating. Makes me wish I went into programming.
You commented on this!
ur mom commented on this
Alan Becker program vs programmer? do i see a new video series in the near future?
MrKyleisawesome123 wtf is wrong with you lol
DragoonGaming MUST. HAPPEN.
This video was my first exposure to neural networks when I was in high school. Now I’m a machine learning engineer at Google.
Awesome
How long did It take to you and where did you start? Thank you
lie
Good for you
DOUBT
This video got me interested in neural networks for the first time. Now, I am living in my mom's basement having accomplished zero with my life since that point. My family says I am becoming a burden on them. Thanks SethBling!
me frfr
Thats also what my mother and doctor said the second i was born :]
For real, for real? No capitulation?
This video got me interested in neutral networks many years ago, and now I'm a software manager running one of the most AI centric teams at one of Europes largest companies! Thanks Sethbling!
That's awesome. Finally someone inspired by a game. I gave up long ago thinking that it was a waste of time. Now I am pursuing ML after finishing my civil engineering bachelor's.
wow epic
prove it
Can y dm me I'd love to talk dude
You have discord or facebook?? Live to talk to you about that
I like how the fittest generation figured out spin jumping is the safest option because it kills most things it lands on or touches. Good job skynet
and things that it can't kill usually you will just bounce off of harmlessly
Kevinofrepublic fucking mental
Ah yes very good observation!
5 more neurons left for Mario to hop out the screen like the movie The Ring
so how to make code like this? what programming language is this?
I started studying computer science 2015. I really never knew much about computer science. I started in the first semester with a programming course and came across this video and I was fascinated by this! Now in the last semester, I am writing my bachelorthesis in neural networks!
You were my inspiration!
please get an icon other than a white background
mediocre ice rink parodies... Why does it matter to u? Fuckin hippo
Yay! Welcome to the new age, Good luck!
@Dawson Harris this aint minecraft
I think my creator that wrote me to be an A.I. ChatBot had a similar inspiration ? :-)
Let’s see if Mar/IO can complete the full game Live on TH-cam.
MarI/O
look at luigi/o
Wubulubadubdub!
I know cheeri/O can
It would take days/months to train on each level.
A year ago I used this video to explain to my class what artificial intelligence was (or something like that, I don't remember) since I live in Mexico I had to translate and explain everything. Thanks for the video :) I learned, my classmates were entertained and I gave my teacher a good impression
@MySonNarkoman good point.
@MySonNarkoman I'd assume it tried various inputs, including those that didn't exist, until it found ones that actually did something.
De donde eres bro
Ah perro
chido man, si de seguro los dejaste inpresionados y fue interesante con el ejemplo del mario
First Super Mario World
THEN THE WORLD
***** but eventually it will realise that it is endless, and will know when to stop
***** like i said
it will find out that it cannot fully kill it, so it will move on
xET3RNALx xEVOx Humans still haven't figured that out and we've been running a lot longer
disreprivalize wait what
xET3RNALx xEVOx using armor stands
"What if you used 100% of your brain at once?"
That's called a seizure.
lol
🤣🤣🤣🤣🤣🤣
Overclocking your brain
@Bold One ... but the algorithm learn by itself... In the beginning it didn't even move.
@@icarue993 It had to be given the instruction that if it sits still too long, it has entered a failed state.
this video is what got me interested in neural networks. from here I started reading further into it, got intimidated, and gave up on the spot.
I guess that’s as far as that evolution part of you got lol. Can’t blame ya there.
Revisiting this video today. This the video that got me into AI. I'm a Deep Learning Engineer today. Thanks, SethBling. Cheers!
Pretty Cool. I'm looking to get into Machine Learning too.
hey, i started workin on my bachelors thesis and the topic is "Using artificial intelligence to discover new speedrun strategies" is there any chance i could talk to you so i could learn something?
This video I saw back when it launched and it made me want to go into programming. Finally, 6 years later, I am a senior Computer Science and Data Science double major who is quite literally learning about Neural Networks for the first time today in my Machine Learning class. Great video even today!
@@ShakeMe158 I love the concept for your thesis btw!
@@TheLegendOfLame yeah, i wish i picked a different one lol, im kinda lost
When are we going to see MarI/O do a credits warp?
Daveyard Holy shit that would be amazing
The Turquoise run it for some years on multiple computers and it will figure it out....
Daveyard if you gave it specific objectives or showed the program it might be able to do that, but you'd have to make mar1/0 play through numerous levels first, and it would have to understand that winning the entirety of the game is worth a massive amount of fitness
CRIMAFUYT Well, depending on how Seth made it, the program could learn that by going back to lose some fitness, it might be able to later gain much more fitness.
Of course, Sethbling can do anything.
I remember seeing an AI learning to play different NES games a while back.
One of them was Tetris, and the AI - because of the way it operated - just kept throwing blocks down without moving them, and right before the last block locked in - which would have caused a Game Over - the AI paused the game and then refused to do any further input, as if it had ragequit the game.
Bright Spark Yeah! There were two programs that worked together called Learnfun and Playfun, the videos are by a guy called suckerpinch and it is extremely intersting to watch
Bright Spark I was thinking of that Vsauce episode when I watched it too lol.
Real AI don't exist yet...
That was learnfun which learned a little differently from MarI/O
Bright Spark vsauce
This video got me into neural networks. Today I'm a PhD candidate on neuromorphic hardware. Thanks SethBling!
This used to blow my mind. Now, these are everywhere and more advanced than ever. Technology has improves so fast I can’t believe it.
the 1k people who disliked the vid were the first few generations of MarI/O. they didn't know the difference between a like and a dislike.
EDIT: HOLY CRAP 1.4K LIKES!!!
I laughed a little too hard at this xD
nerd humour, sad
Four4 ok
haaaaaaaaa
No were afraid of a robot uprising
Then one day Mario became aware he existed… that day was known as judgment day
This was everyone's inspiration for learning ML
I guess it was for me, lol.
yeah
It was for me!
Absolutely
You are so right
8 years later and im seeing this on TikTok live
Absolutely amazing! I love how you explained this!
hey ant!
Hiii
***** Hey ant! I'm with Awsome Batz!
indiesoftgaming dafuq
The guy you saw at the mall today Well that's good to hear. The sooner you move on from you-tubers like him, the sooner you can find decent, more mature content providers.
When a game has no cheats and you know how to program.
Kandriod lmao Trueeee
By the time it figure out a way to beat the level you'll ne halfway into the game progression.
Jean Mathieu Lepage
But what's it learns how to beat the level though I think it would get to the end of the game before you.
And the time you need to code this shit?
Kandriod WOAH TECHNOLOGY
SethBling will make a sentient being using Mario World code injection lol, this whole stuff is super amazing, love it :D
This is one of the first algorithms and videos that inspired my to get into machine learning. I now have written a couple algorithms and have my first pull request for Tensorflow. Thanks Seth!
0/10 No armor stands
McDanny420 lol
McDanny420 xDDDDDDDDDDDDDDDD
Now make it play Dark Souls.
that would be fun
12357 try's later it gets past boss two
+Golden Clam Still better than me :D
Yes but it requieres more controls and more varibles
+Mr NubSkrub Yeah, especially because it would need to navigate through a 3D level. It would probably very complicated to make the "readings" in a 3D environment based on the camera view but it could probably manage it.
Idea, make it play GTA 5, see what happens.
I've watched this video when it originally released, and now I understand way more things. The explanation is very clear. Great work on this plugin!
Hey seth! I'm currently studying machine learning and just want to thank you for being my inspiration of sorts when I first saw this video. Really interesting video and well done for creating it!
So, now that we have games that play themselves, we only need to rig a chatbot to comment on the gameplay. Et voila, the first automatic let's player.
Now to find something to replace the human viewers.
Something close to that already exists: watch?v=Qhh0igzqtqY
This is a video about a game commentator AI commentating PUBG gameplay.
A Box I laughed far too hard when I entered the link
The last part is solved, bots that 'watch' ads.
so sad ur mad
imagine what will be possible in let's say 50 years: an AI that can beat Dark Souls
That's pretty NEAT
+Angelo Christo No, there! --------> Pun
Neat pun
Im scared now
I'll answer your question- you have to go to MACHINE-ama and watch this video about learning for Video Games
+Marmori Pelaa :o Neature Walk
Man, I miss the MarI/O streams. They were great to just chill for a while.
Today: Mario stage.
Tomorrow: Skynet
>kek
piff
next week: the world
In 2 days: get some milk
milk is rape
And this is the prequel to Terminator
LOL
+Lyfe Slap Maybe..This could also be how Hal from the movie "2001" A Space Odyssey" evolved.
the og random yt recommendation about ai
weird to see how things changed in less than 10 years
RUPERT WILL PREVAIL
George better
4:55
I understand completely what Seth is saying.
Yup. Totally.
+Finn Else-McCormick i actualy realy understand XD
Formal Cat
Everyone can be smart if they want to. It's a choice. Noone is born smart. :)
+MasterGamingForever Yet you can't spell really right.
Probably from america if you can't spell lmao
ManyAlpacasYT
bulgaria
HI GUYS! SETHBLING HERE! TODAY I RECREATED EVOLUTION TO BREED A SPECIES THAT PLAYS MARIO. THANKS FOR WATCHING!
Fraktallity - Fifa 15 Videos *Cipher plays*
TheMCDuck 2016 Using armor stands
Welcome back, SethBling here.
Today I made minecraft inside minecraft using armor stands, so you can minecraft while you minecraft while you minecraft!
That's about it, thanks for watching!
Yo dawg, I heard you like Minecraft, so I built Minecraft inside Minecraft so you can build while you build!
( ͡° ͜ʖ ͡°)
This was the first video that got me into neural networks. I've made several AIs that played games based on the method used in this video. Thank you so much Sethbling!
But does it get salty? Because once that happens, humanity will perish.
Mark these words, that’s exactly what will happen. Keep updated with world news, especially today. Things are escalating, soon the volcano will blow & full disclosure will begin. A NEW AGE IS UPON HUMANITY 🙏🏽
@@Bunkabusta73 ok
Nah.
It'll buy a couple of puppies and sulk in the corner with the puppies.
That's what the AI that played the Stock Exchange game on NES did.
@@Bunkabusta73 I agree. A new age.
It will when it starts getting repeatedly softlocked and killed on pick-a-pipes on shitty Mario Maker 2 levels.
The game's playing itself, Jon.
As someone studying Computer Science, this was great, thanks lad :)
thenthapple lol you're the guy who makes legend about fallout and some fallout things right?
Eren Mortel aye :)
thenthapple I would like to see it try ttt (trouble in terrorist town) Would be pretty cool to see what it does.
Ckinsman or a more reasonable game, cloudstone
thenthapple Black hhhg nc vjhc:frryhhjjjhhvz tb knjjbv gym
jbjjjj
Few year back i watched this video as a newbie student and it give me a motivation to pursue AI as my career. Now, I'm writing my Master thesis and will soon join a company as Machine Learning Engineer. Revising this video feels so nostalgic. Thanks SethBling. Kudos :D
That was amazing! I'm sure you have had fun doing this. Nice job!
Better algorithm than TH-cam's.
yeah, much much better
heh
Truth
Well try to make worse
And yet, here you are.
This guy's pretty damn good for someone who's deaf and colourblind.
lol
what?
He's referring to the AI, since it can see the different threats only as identical black squares.
zsdfasdfas ah okay
Car Of Doom THAT DEAF DUMB AND BLIND KID, SURE PLAYS A MEAN MARIO
Thanks for providing the source code and the paper! Really appreciated it
that 4:04 numbers is so beautiful. just to think and imagine how many millions of Input and Output (of the function) the original data sets of numbers has to go through for that 'neat' algorithm. Great project man.
Interesting stuff.
Phew. Blown away. Even with the process simplified like this, I am still struggling to conceive the actual coding involved.
Wow. Totally cool. Really interesting!
Steve Dowe HINT: Look at the source
Thanks Albert Zhang - I didn't realise it was open source.
haha. Always got to look in the description :p. Pretty obvious considering this is Sethbling. I don't assume he'll make any money off of this anyways.
(outside of youtube views)
Holy crap Seth, this is insane lol
If I wanted to teach myself how to do something like this, where would I start?
TensorFlow
come back to this video once every year and it still impresses me
This is by far the best video I've seen in this year. Tks
"Hi Seth Bling here. Today I'll be showing you my time machine."
using armor stands
@@martinungar6146 and no redstone
Yesterday
@@reuben4721 in a 3x3 space
“Hi Seth Bling here. Today’s I’ll be showing you my time machine.”
I wanna do something really stupid. Create a bot like this for CS:GO
how is that stupid lmao
You can get pretty much everything you said from memory reading. Player position, health, enemy position health, view angles, enemy view angles, pretty much everything is stored in memory. :)
Source: Thats how aimbots are made.
I dont have the knowledge & passion for making such.
***** We never mentioned anything about aimbot.
***** Because you randomly just talk about aimbot.
Absolutely Amazing. thank you for the visual representation of the neural network.
This video was part of my inspiration to begin pursuing machine learning 5 years ago, thank you SethBling!
Have u mastered the subject?
@@abhijithbinoy875 I know enough to do useful things. 'Mastered' is hard to define
I guess this is pretty neat.
Killermy3 Ba dum tsss
Get out.
+Killermy3 dammit, i was beaten to it by months! that's what i get for arriving late.
Anyone else see the glitches item box?
+Christian Evrard yes
Now try it out on Kaizo mario.
could take years
+HG | Meta It will take like a million generations before it can beat a Kaizo level hahahaha
CoTeCiOtm Yup.
+HG | Meta Will take forever, but it will be possible.
That will likely take at least 5 days to learn.
The ChatGPT boom brought me back to this video after 7 years.
Very intresting and well doumented video.
Also that outro, nostalgic
Is it possible to let it keep evolving until it can beat the whole game?
Samuel Nielson I mean is it possible to do with the current processing power we have?
Generic Username yes it is. and when it starts to learn it will be faster to learn more after some point.
Generic Username Set it up to twitch and leave it running. people will pay for your electricity bills
willky flame I would if I knew how.
TheHiroo17 Then we need to change how his fitness works.
can the ai apply what it learned towards beating the other levels now?
if the elements of the level are the same yes it can
This implementation is very specific for this level (overfitting), therefore so it needs to be retrained for every level.
No. Since it can only differentiate blocks it can stand on it has no real way to recognize a threat other than by running into it a few times. So this would allow each evolution to only be applicable to one level
hepotitus ah good point, my bad.
DarkaGamer A GAME THEORY, thanks for watching.
Impressive stuff, I'm taking a real liking to Machine Learning the more I see where it can be applied and what it can do.
Random mutations oh boi didn't expect that, they sure make great stuff this last decade.
This video is so useful it was literally used in one of my CompSci lectures - well done
That moment when you have taken machine learning and A.I. courses, and you still have no idea how Seth was able to do this.
I'm afraid those courses might have been complete scams.
Well now we know how machines will destroy humans!
MrChipelo but it will need some trys to learn how to do it first :p
MrChipelo By... jumping on their heads?
MrChipelo Dont worrie, the machines will walk against walls a couple generations long before they figure out how to aim and shot at people :P
TheZapDude that would work...
MrChipelo Yeah it'll take 1000s of generations of robots to kill us but yeah thats how we die.
This video exposed me to neural network. Today, I'm a philosophy teacher who educates people on the ways that capitalist megacorporations are using this technology to, instead of playing Mario, oppress and harm people around the world. Thank you so much!
Friend, one of the most incredible things I've seen in the last few days. Are you crazy. If you adapt that language to another purpose, wow! Amazing. Congratulations
this video was on my first exposure on A.I during my years in highschool, and now I am Elon musk. Thanks SethBling
now let's get real
*AgarI/O*
*slowly claps*
I wonder if this can work with something like Runescape for mining and such. I know there are better tools (bots) for that, but I wonder if it could work.
The Game Replay I have no doubt that it would always do genocide runs
So much this
No prob
In the future DEEPMIND can do this
//maybe :P
Seth you should make a programming tutorial series
+CaptainAwesome I'd be awesome if he could make a tutorial about NEAT!!
+CaptainAwesome ya good idea
+Björn Wallden the resources on neat are kinda slim anyway
+CaptainAwesome And how about you learn it yourself?
+Mikiultima and how about you just shut the fuck up you little bitch?
Still one of the most interesting Mario/Machine videos I’ve watched here.
Your coding is really neat and satisfying to look over ngl
Welcome back Sethbling here, I've made Ultron!
Are there any other videos of people doing things similar to this? I'd like to see more of it. Maybe in a year or two, someone could secretly shove a bot like this into TF2 servers.
It would be a lot harder. But possible.
COYADD Idk..I imagine that if there were, it would probably say something like, "How about a nice game of chess?
This evolution might take thousands of years. Adapting to never changing environment is one thing - adapting to intelligent humans, who've been evolving very, very long is so much more complicated.
Егор Цебро I like pancakes.
Ben Warters Nope. I don't need nerds that don't know the difference between "joke" and "reference"
*Albert Einstein:* “Insanity is doing the same thing over and over again and expecting different results”.
*Machine Learning:* Am I A Joke To You!
Musicians and Athletes call it practice.
@@xdevantx5870 true
You're always slightly altering everytime until you get what you want though.
@@Superkangaroox
Learning from your mistakes and evolving little by little 👍
@The Monster Under Your Bed ya. a mutation is by defintion - the changing of the structure of a gene, resulting in a variant form that may be transmitted to subsequent generations, caused by the alteration of single base units in DNA, or the deletion, insertion, or rearrangement of larger sections of genes or chromosomes.
I can't believe this video is over 6 years old already
These are fun but the problem is that people think this is somehow equivalent to the computer actually having subjective consciousness. It doesn't.
EGarrett01 Neuronal activity is also cause-and-effect due to electricity. Just saying...
ok.
I wish more people understood this.
I think our minds are a holographic medium where our evolved neural networks are constantly cross examined for fitness criteria given the current sensory input and past expectational input. Imagining the future is creating a memory about a possible outcome based on those two different criteria for fitness matching up. The holographic mixing is done at the frequencies of two different ion cascades forming resonance with the geometry of the brain.
in essence your neural network is the 'what'. The brain matter you are made of has evolved since you were born. The 'how' of subjective consciousness is the activity of these neural networks changing in response to the overall wave pattern responsible for correlating various evolved neural networks. this is the binding problem of consciousness. your experience is the interface or feedback loop between neural networks and the chemical cascade controlling those networks.
and im here failing to program a calculator
You can't program a calculator? What language are you using?
+isectoid maybe he's a beginner beginner? I started programming with python knowing nothing about programming.
***** I'm a c# noob. I was just wondering if I could help him out.
Gaiacarra Calculators aren't actually complex, but I see your point.
Other way around. Computers are just really complicated calculators.
Thanks for getting me interested into neural networks
this self improving neural network stuff is playing god, I love it.
Okay I think I got everything...
...but where do the armor stands go?
did you try this neural network on a new level to see how it would do ?
This is the video that got me into Machine Learning. Thanks for inspiring me @SethBling
I've been fascinated by this video for years now. This video got me interested in machine learning, which motivated me to start a masters in AI. Finally downloaded this algorithm and got it running, thanks for providing the source code!
how did you get it running? ive managed to get lua and bizhawk running but i havent been able to run the evolution program
@@charlieproffitt5809 Make a named state called DP1.state at the start of the level you want to run. Open the LUA Console in the tools tab and then Open the NEATEvolve script
@@rene-of3sc ive got it running, ill probably be able to get it working now thank you
Citing this for a university report.. feels kinda strange writing "(SethBling, 2015)" XD
Welcome to the future! XD
Can I see that report? :)
I still Cant get over how amazing this is
Excelente muestra de Machine Learning. La técnica de este programador fue la de 'Prueba y error', el algoritmo primero ejecuta pruebas y tomando en cuenta los puntos críticos, guarda el estado analiza las posibles acciones ante el estado crítico y vuelve a ejecutar la prueba con una acción en el punto crítico. En este caso la inteligencia aprende de los errores. Otro punto a considerar es que el algoritmo únicamente entiende la acción de saltar en el punto crítico, eso significa que no fue programado para acciones como frenar, detenerse, etc.
I'm a data engineer, never heard of you until this. I've just subscribed.
When seth goes from playing video games to making ai and nuronetworks
what the fuck dude. "welcome back, sethbling here, today i've made a robot revolution in our society out of command blocks."
Machine learning is fascinating! So many applications! I need to learn it.
That's preety awesome! After researching about AI and Navigation meshes, i now know more that will help me in my Blender projects!
You wrote this in Lua? You poor soul :(
Lua rocks man!
java & c++
cool
java is thicc
What's wrong with Lua?
roses are red,
violets are blue,
there is always an AI,
better than you.
..and theres always a South Korean better than it.
Roses are red
famed mustachio
of Nintendo fame
ZA WARUDO.
Unless we're playing GO...
"Famed mustachio
Of Nintendo fame"
time to call the department of redundancy department
Altourus OOOOOOOOOOOH SHOTS FIRED!!!!!420
This is so cool, congrats!!!
You inspired me and gave some idea about machine learning. Thank you, SethBling!
Ah, memories of watching BoxCar2D for endless hours of the night...
I still have a bookmark and leave it running some nights. Forcing 1 wheel on speedway makes some strange things
holy shit that's awesome!
I got a three wheeler in the first generation that rust drove off until it disappeared :OO
"You're watching a skilled player playing Super Mario World"
*Sees Mario doing 360's*
Skilled, yeah. Damn, those skills...
I’m so happy I found your channel
Awesome work dude