NES AI Learnfun & Playfun, ep. 2: Zelda, Punch-Out, stocks, etc.
ฝัง
- เผยแพร่เมื่อ 16 ต.ค. 2024
- Six more games played by Learnfun & Playfun; some good, some not so good. This is a pair of programs I wrote that learn to play Nintendo games using an amusingly simple technique. For the technical details, downloads, and more videos, see:
tom7.org/mario/
Continue with episode 3: • NES AI Learnfun & Play...
![เปิดใจ "อาจารย์เบียร์ คนตื่นธรรม" อดีตเคยสุดทุกทาง ถ้าใช้หนี้หมดไปบวชแน่ l [Nickynachat]](http://i.ytimg.com/vi/IxeE0xVhy08/mqdefault.jpg)
![Uppestcase and Lowestcase Letters [advances in derp learning]](/img/n.gif)
"Doesn't care much about bytes going down, only about bytes going up.."
PlayFun is an inspiration to us ALL!!! This is how we should live.
This mini series is the most interesting stuff ive seen in a long while!
I appreciate that, thank you for watching! :)
suckerpinch I could see this being a let's play type of channel maybe you versus a well versed playfun? idk But I subscribed and I love this stuff xD
***** Sorry about that, there was some badly timed maintenance last night and it crashed the host, ugh. Should be working now.
suckerpinch This is probably a dumb question but is there a way to download and use this on my computer? I want to try this on minecraft.
Justin Nicholson The link in the description will take you there. It only works for NES games, though, and it's not very user-friendly, so be forewarned.
Isn't weird how you put a personality to the AI inadvertently
+monolyth421
Yeah it is, but the anthropomorphisation of the AI is so hilarious to me, in the last game I just could not stop laughing.
+Lint especially when he said "Playfun gets super stabby"
@@politure hahaha yeah I especially loved the last video where the ai paused the game so that it wouldn't lose
Seriously cool program but it's kinda disturbing watching it get the code version of an endorphin rush every time it stabs a human
I find it more disturbing that humans get the same rush in the same circumstances.
Feed it more!!
I'm glad these are only computer games, not anything possibly lethal.
Turns out that stabbing people gives you a lot of points in that game.
Your commentary is what makes this. Brilliant and hilarious at the same time.
(: Thank you very much!
Well that's rude.... I happen to like your explanations along with the gameplay. Don't take what the youtube comments say to heart, the internet is full of douchebags. This is one of the coolest things I've ever seen.
What's rude?
well, you know how to end videos, that is a fact
ha ha thanks :)
Indeed, that was hilarious!
The computer program is a genius at times, it learns so well! And your commentary and little inserts of funny skits is amazing! I laughed pretty hard XD Thank VSauce for showing me your videos!
I'm glad you liked it and thanks for the nice comment :)
suckerpinch I have been having trouble running it could you do a tutorial?
suckerpinch Are there plans for new things on this channel?
suckerpinch I'm learning programming myself, so watching your videos really gave me a great insight on what you can do with it. I found the whole part on the side (the PlayFun's happiness meter?) especially interesting :) keep doing what you're doing, man, both on and off of youtube
JPK314 Yup, I have some new stuff in the works for both this project and others. Sorry that it takes so long!
Dude this is great stuff, I laughed, I cried, etc. And most of all, I'm disappointed that people turned you off of talking about the CS and the math! that's the most interesting part to me.
Me too! But there isn't much new technical material in these. Next video will have some new CS. :) Thanks for watching!
You still reply to comments!
Learnfun vs TwitchPlays
Good idea
TheTownzFinest Talentless Skill vs Skillless Talent
Prince Rebollos Amazing idea.
wrr
There's one problem though: LearnFun takes an hour to play for 2 seconds.
Mark my word, this is the next evolution in lets plays, "Let AI Play"
+raumaan kidwai artificial intelligence.
I find it rather cute that youve called it a "he" several times and its main goal is to get bytes to go up and it can do this by just wiggling a cursor and its happy
That moment when it realizes the objective of Zelda isn't "make the name entry cursor move to the right".
You need a girlfriend badaly, bud.
@@Dziaji bro I made that comment when I was like 15 years old, don't dog on lil smooth operator 😭
7:17 Earning a star gives you an additional 100 points, so that's why it was so intent on getting stars.
This is the most interesting and entertaining thing I've found on youtube in a while. Great job, you created AI and accidentally gave it a hilarious personality lol
+GeddyMX Thanks! :)
+GeddyMX 22:10 My favourite lol.
+GeddyMX I wonder whats it gonna do if it could talk
how satisfying it is when something you code that works even partially
There is something so adorable about this
Pandsu Yo i'm so glad i'm not the only one who thinks so
I love how it pauses the game so it can't loose.
i almost die at the end, jajaja greeting from Chile, great videos
that 'but he didn't say I couldn't do drugs' line took me so off guard haven't laughed like that for a while
I think it would be interesting to add a praise button of sorts where you can tell it if it's succeeding or not and see how it affects it
Extremely enjoyed this episode, cryed laghing watching this episode.
thank you :)))
i love your commentary, its good for chuckles that don't make me miss information and have to rewind, also, it never feels like you're forcing the humor of the situation. Please keep these up!
I'm glad you enjoyed it and thanks for posting!
20:29 "And Playfun get's stabbier and stabbier as time goes on"
I couldn't stop laughing at how much it was just stabbing away xD
Agree so much.
"should I read the paper? Should I touch the computer?"
Dude, this is amazing. Actually letting a machine learn how to optimize objectives by "learning" (genetic algorithms, machine learning, neural networks) is a very popular thing, but the fact that really amazed me is how your algorithm is incredibly good at finding bugs and glitches in its favor.
The fundamental idea of science is the discovery of stuff in nature that doesn't make sense and the need for humans to understand it. Your algorithm lets the computer do the job of finding this stuff.
As a fellow computer scientist and being as stoned as I am now enjoying your video, congratulations and keep it up!
It's funny how most humans have curiosity to go into the first Zelda cave before walking away, yet the computer doesn't care or know what that is.
Yes, it does learn any music stuff that is manifest in RAM. There's usually some kind of music "cursor" that keeps track of how far along in the given song you are, and that sometimes confuses it because it looks like it's making progress. (But that may discourage it from doing things like pausing, so maybe it's useful..)
i love how the AI becomes really "sad" whenever he wins in punch out
I initially watched this to get a grasp on the whole 'only winning move is not to play' thing - after / during a conversation i had with a friend about whether or not war is a viable response to things like 'terrorism' .... (war...thermonuclear war.... etc) ... and now I am hooked on how this AI learns and plays stuff!
"Stabbier and stabbier..." OH GOD SKYNET
In all seriousness though, this is amazing. I'll watch any videos of a computer playing a game, it's always so interesting.
I'm sorry that I'm 9 years late, this is quality content!
18:19 "Russians, they were like - all bad."
And so the pendulum swings...
I haven't had tears of laughter in years, but this did it
Aw thanks! :)
Anyone else notice the cheat Playfun does in Punch-Out! at about 8:00? He does 2 super uppercuts and only loses 1 star.
Wild! I totally did not notice that. Is that a known trick?
suckerpinch I am not an expert, but my usual resource I check for this, the TASVIdeos game resources pages, doesn't seem to list it. This of course might not mean it's unknown, it might just be that it's not possible for it to help in a speedrun for some reason. tasvideos.org/GameResources/NES/MikeTysonsPunchout.html
PS, this is really incredible work you've done here, would you ever mind doing an email interview or something? I have some questions I'd like to ask you about your AI.
***** Yeah, I wonder if maybe stars just don't get used up if they fail to connect or if they're during an opponent's special dances. Feel free to mail me some questions, which I will try to respond to subject to time. :) The paper linked in the description explains a lot of how it works.
suckerpinch I just threw all my stars away during Piston Honda's dance as a test, looks like they do go down. That being said, I was playing Mike Tyson's Punch-Out so it might be different.
Most of my questions will be quite silly to you I am sure; it's more about my curiosity in "machine intelligence" than it is technical implementation questions. I'll drop you a line in a bit. :)
This series of videos singlehandedly made me realize that I need to pursue a degree in CS and study AI. Thank you for showing me how amazing computers are :)
Wow, glad it inspired you! Don't give up! :)
"Maybe he is waiting there to the cold war to end" I'm fucking dying xD
Very interesting, and really pretty funny - your re-enactments are appropriately awkward and spot-on!
I think my fav part has to be at 20:45 - that crazy stabbing spree had me waking up my S/O with hysterical giggling.
Do you have any plans to extend the software in any way, make it capable of understanding more concepts, planning further ahead, and so on? Or perhaps being able to figure out how to play on its own, without the need necessarily for you to demonstrate it beforehand? I realize it'd be a lot slower that way, since it would have to more or less randomly discover favorable moves and techniques to a larger degree than it currently does. At least that's my understanding, that right now, it puzzles together small sections of moves that you've done? I did just watch part 1 beforehand so you'd think I would know the answer to that...!
Either way - I'm not a computer scientist or into AI so it goes slightly over my head, but it's fantastically interesting anyway!
Mythricia Thanks! I do have some new technology on its way; I'm sorry it goes so slow. Completely unsupervised approaches are something I'd like to try eventually! Long-term planning is probably out of scope, as we say; I think that requires a totally different kind of technique.
suckerpinch Cheers, good luck with it all. I look forward to more of this stuff!
@@AssassinXMod You are using an AI? Just... What did you expect? lel
I just love how the AI doesn't care about dying until his last life.
So it learns from it's own mistakes and improves?
So, given enough time, he could beat any one game flawlessly?
I think it's only ever using the initial training data to find variables that it considers objectives. If it were able to better analyze the memory during play and realize things like "this variable just keeps going up no matter what, so it's not important" and build a better picture of what variables are actually important (and what states they should optimally be in), it could gradually improve.
I think he addressed that in ep. 3, where in Mario playfun would jump down into death in stage 3, and was able to keep moving forward so it found that to be the most important variable. He had to hard code it to make it realize that there is penalty for doing that. And even then it died twice before continuing the level.
I'm wondering if he's ever going to make more of these, it'd be interesting to see if he could evolve it more to make it learn from it's mistakes a little better.
Kenneth G Actually, I didn't hard code it to give it a penalty, I just gave it only three clear objectives, which seemed to work better. I think that the objective learning part can be improved a lot. I've got some more stuff in the works; thanks for your interest! :)
suckerpinch is it correct to say that you're implementing some kind of artificial neural network that learns by itself, given enough time and generations (lives in the case of videogames), and following basic darwinistic elementary objectives like "stay alive", "collect stars" and "kill enemies", that he infers as being good objectives from the NES data streams after you played for the first time?
VperVendetta1992 It's not a neural network and doesn't evolve, no. Not all AI is like that. It's much more like game tree search. You can read the paper linked in the description to learn how it works.
Computers playing video games are so cute for some odd reason xD
Please do more of this videos! I am studying computer science and I also wants to get on this field of learning machines etc. It is very cool what you did there...great job
Dude....this is EXTREMELY interesting as well as hilarious. Bravo.
Chris Kononowech thanks! :)
I love the image of a daft punk style robot sitting in a wall street office, doing nothing for a few days, suddenly getting up from the desk one day to buy a dog, coming back, buying some stock, and then sitting idly for another 10 days while it continues to lose money
"It drowns it's sorrows in dog shopping." XD I can't... I can't even...
I'm not going to lie, I did get a few good laughs out of your commentary, and even live acting, but I honestly think I appreciate the more serious approach like in the previous vid more. Don't be afraid to nerd out and get down to the true value of this technology. I feel like the comedic approach, although entertaining, undermines the value of what you've made here, and turns it into a joke.
As you've said, this is not an April Fools joke. It's real work, with a real purpose.
Your programs are amazing and you are completely hilarious! I could not stop laughing. I would love to see many more of these!
+Michelle Marks (: Thanks! There's already an episode 3, and then you could just subscribe and wait a million years for me to finish this next one I've got in progress...
As an undergraduate CS student who studies functional languages, I really appreciate what you're doing here.
This video is funny because of the way that the computer tries to work out things, especially with the stabing that it does in the game at the end.
Just decided to cling onto the ladder, move up and down a little bit and then proceed to flying crouch stabs to the enemy LOL
Finally, the difficult but necessary work of playing Nintendo can be carried out on our behalf.
This is great! Love those parts where you acted it out, haha. Vsauce brought me here.
How do you set the coefficient of the proportion between objective function (game score) and the pixel change rate (or happy, sad score). Is that part of the optimization ?
This is amazing, can't wait for the rest. The commentary is very funny, good on you.
Can I ask a few questions??
1.can it self learn from its mistakes?
2.is it easy to set up the program or can you make a video about it
That ending was great. lmao
Loving that profile pic
TheGameShow14
:)
That stab technique had me laughing, I can only imagine how much processing it was using in order to flail the attacks like that.
This is better than TASbot! I don't think I've laughed that hard in a long time.
"Well maybe. I feel. STABBY." -PlayFun 2013
TASbot was never impressive to begin with, its just recording of most frame perfect playthru
play fun is proof that an AI will ultimately become a bloodthirsty force to be reckoned with.
This is my favorite thing ever
Aw thanks! :)
mine too. more pls! i'll sub if you do. and dont if you wont.
Your humor and sarcasm are admirable, the playfun imitations are really great.
The graph shows a lot of bytes increasing when he's on the ladder (such as at 19:35). Does that mean that the program believes it's getting points on that ladder?
Yes, though it's usually easy to find things that are going up, because of internal stuff like timers and counters (e.g. related to the music playing, which is always making progress).
Dude.. you don't get enough credit for what you've done. Your views should be in the hundred millions, this is really really cool watching an AI play games is very interesting and trying to see how it solves it. Lookin forward to new videos about it :)
Those stabbing skills are amazing though xD
GG64du02 xD
GG64du02 Hope so ;D
22:00 LOL, the satisfaction meter follows the music!
Make more, this is really enjoyable to watch, and not many people make them. I got it myself, and it's learning to play mario NES right now, and I really suck at it, so I wonder how it'll end up. I have a question: Can it get good enough to perform arbitrary code within the game to hack it's self infinite points, by performing certain actions at certain times? Of course after many weeks.
ThatOneBerzerk Thanks! More in the works. It only presses buttons on the virtual NES controller, so no arbitrary code. :)
suckerpinch Yw, and is it normal for it not to get past the title screen? It's been stuck there after about 6 hours of learning.
ThatOneBerzerk The learning phase is learnfun.exe, so it probably won't get better if it's been on the title screen for 6 hours. Sometimes title screens are vexing because the memory doesn't follow clean patterns (or because starting the game resets critical game facts like your score, which looks bad). Sorry :/
suckerpinch It's ok, because I got it working now, it beat level 1-1 on it's first try! I might upload it. I'll give credit too.
Lol Tom you are such a good game commentator this was both hilarious and fascinating at the same time
Jeffrey Wong Thanks Jeffrey! :)
Your voice is so relaxing.
Awesome, dude. The program, the commentary, the skits, all solid gold. Congrats!
I'm sure that other people have asked the same question, but what would happen if you programmed the AI to care about points going down as well as going up? Would that make the AI more careful in games? Or would it be too careful and just avoid everything?
I haven't tried it yet, but reason I didn't do it more has to do with overfitting: The more expressive the model is, the more data it can explain, and then the worse that it generalizes. I will try it some time, though.
suckerpinch Awesome. Also, are you able to run a two player game with two copies of the AI? Would that at all be interesting?
***** Hmmm, interesting idea. That would certainly handicap it a lot, but might show how a future real-time version could play along-side a human. I'll give that some thought.
suckerpinch Great. I really love what you're doing with this project, and how you're presenting it in the videos. Its definitely one of the most interesting things I've seen on TH-cam in a while. Keep up with the great work!
That was great! I was laughing at your renditions of the AI, and the AI's performance on the last game.
I'm so glad there are three of these! :D
ML has come a long way! -Viewer in 2021
"Watch this advance stabbing technique" made me laugh really badly you are awesome
thank you and thanks for watching :)
I love the humor so much!!! Please keep up the amazing work! this is not only very interesting but very entertaining and funny
thank you :) More in the works!
Im 7 years late to this but its an incredible thing
Im wondering if there is a way for playfun to pickup where it left off after being run after closing the program so you dont have to restart from frame 1 again
More videos about this please. It's scary and amazing at the same time. It feels so human when it pauses to avoid dying. Like it's scared.
So if you leave the program learn fun going for a really long time, can play fun master a game?
"You don't need to worry about this thing taking over" oh Tom, if only you knew
so curious if this could even be semi-functional on ninja-gaiden
It would either destroy Ninja-Gaiden or get destroyed, there is no middle ground in Ninja-Gaiden.
Oh man, 16:22 and 22:10 I lost it. The little skits are hilarious. Fantastic work, dude.
best end ever ^^ man 2 videos and i had to subscribe. your doing a great job
Kleinernervenkeks thanks! :) There's one more for you and I'm working on another round now...
Watching your hand twitch slowly over the keyboard was the funniest thing!
Patiently waiting for douchetrade 3.2
Oh my god this has to be one of the most hilarious things I've seen this year and I don't know why.
It's sooo happy when it's playing Dr Mario badly!
That "douchetrader.exe" footage forced me to hold my breath because i'm supposed to be doing homework and my mom is right there
I know this is out of context but I would really like to see "it" play FNAF or any horror game. I really hate the game but I wanna see if it's possible or possibly play with another AI that is just the same as it is like CS:GO in a small map 1v1 something like that. Of course it will be difficult to implement but this is just a suggestion and it really impresses and astounds me very much.
I agree. It would be pretty cool to see.
Think about it:
Your machine VS. Four other machines!
That won't work, it is only a simple program, written only for the nes. If you watch the first episode, btw, you would know that this isn't realtime. It is the result from hundreds of playthroughs to get the best "score."
NRG Player you know what would be fucked up if the ai gets better then humans in an online game
calvin ouwens See chess.
Waffles Syrup
but then u just like buy a ai and own online while watching tv
You're commentary is honestly hilarious. Got me laughing pretty hard. 10/10
lol i love these videos man! thanks for the laughs:)
the last final seconds are amazing
Holy shit this is the best! ^^
I am dying of laughter seeing that 'AI' stab all those ARs. (Artificial Russian)
Very impressive, and I hope we'll get to see some more videos of your progress soon! :)
Aw, thank you :)
I saw that "expert cursor skills" parody and subbed instantly.
Great vids, btw. I'm always exited by neural networks. Keep up the good work.
Omg, ending was really nice as well :D
Could you stream him on twitch? He'll be the best streamer ever! He's strangely adorable and a great creation!
Sorry, but it takes an hour to play for 2 seconds.
"What do you mean? I run faster with a knife! Everyone knows that! pfft..." - FPS Doug
Burst out laughing at 3:45
Rush'n Attack was brilliant :)
also the dude saw the future of the cold war ending and then the future of it swinging back
42GB OF RAM BEING USED‽ WHAT ARE YOU‽
64GB!
suckerpinch
how_do_you_hook_that_up?
It's just a normal high-end motherboard with 8 8GB DIMMs in it. Not even that expensive in 2014, but also not that useful unless you are doing some crazytimes programming.
Alan D. "the games", for anyone who dos't know, needs gpu more than ram.
"I don't know!" :) .
I lost it at the wall street game... amazing.
This is a amazing serie! I'm laughing too much... ;D Keep up!
+Argande102 thank you for the encouragement (:
I actually got how it works! Learnfun watches you play the game, and it keeps track of the techniques you use, and uses those technique to his advantage.
It's cool like you're still active in the comment section of a 2 year old video LOL :D
Bers Tataew Yeah, I can't help but click on the notifications. :) It's fun to see that this is still interesting to people!
I've been blown away, you sir earned a subscriber. You can thank Vsauce for helping me find you.