Its really funny how the AI got so good at around the 16 hour mark that it forgot how to handle the ball spawning on its side of the field (which only happens after it loses a point)
I think that's because that angle makes it really easy to squeeze the puck between the bottom wall and the paddle to get high-speed shots consistently. I know because I used to use that against my brother lol
At this point the best bet is to divide this base AI into two so that they can play against each other in two player mode. This way it can get as good as it can against any opponent, since it is just getting good against the cpu exploiting it's weaknesses; however, if you were to place it against a random player it might not do as well. Furthermore, it itself has weaknesses, so a separate AI exploiting those should teach it properly.
Cool video! Gotta wonder what would happen if you put this AI up against itself though - would it just have a crazy endless game where neither would score or would it need to learn more before getting there?
Honestly I have no idea! Not sure if they would just become like gods and no one could score, or if they would get really good at directing their shots so the other player couldn't block them.
I like how at one point you can see the enemy AI perfectly track the ball's vertical position. Then suddenly in the games it's so sluggish to react. It feels programmed. Contrast to your ai, which looks like it's actually trying
Idea: Put it in a shop and allow people to play it for free all the while collecting training data. Keep the existing training data as a starting point but let's see how well it gets against humans after a month. Or, rewrite it to play against itself in 2 player mode.
Yeah that would've been entertaining, I might try that on some other videos. Is it 14 points to get the platinum medal? I might've gotten it while training a couple of times since it seemed to be close in most of the games I watched. Perhaps I should've let it train for longer!
@@aitango According to Google it's just 14 points. I wasn't sure if maybe it would penalize you if the CPU opponent scored, but I guess not. I wonder if it's possible to get scored on 14 times, and score 14 goals in the same game, and tie and still get a platinum medal. Maybe your AI is the bot for the job?
Do you think, you could make an AI beat the Wii Play tank game, or would it take too long to train it, given how much levels can vary? Maybe you can have it learn just one extremely hard level in that game?
Thanks! I learned a little coding in school when I was about 14, then I got really into making games so spend hours learning to code that way! I have mostly stuck to Python, but also done a couple of others here and there
I love this! Really interesting that the AI seems to prefer to hold the paddle at that 30 degree angle. I guess it makes sense because it gives it a lot easier access to hitting the ball in whatever direction it wants with only a slight change, given the circular end of the paddle.
Glad to hear you like it! Yeah I think it just gives that extra flexibility, and also bouncing it off the wall just seems better in almost every case than just hitting it straight
Would be amazing to see AI try and take on 2003 Strategy AI from a game called Rise of Nations Extended Edition. Those AI are absolutely brutal in terms of strategic skill if you have them set to toughest difficulty.
love how it looks like the ai was struggling with getting stuck on the walls cos the walls actually stick u in this for some reason. my mum always used to struggle with that lol
The Wii CPU is just following an algorithm, or set of instruction that do not change as it plays, hence it has no capability to learn. This AI however is able to modify itself to improve! Maybe I could play against the AI, I'm not sure if I'll do it for laser hockey for Mario Kart its a bit of a dream of mine to eventually do, and get the AI to beat me!
The Lazer Hockey turned into DBZ after 8 hours, very riveting to watch. I wonder how the Ai would do against another Ai like that? Maybe even a copy of itself?
That reminds me of when they taught an AI to play shooters and eventually they ended up never leaving spawn since the punishment was more likely than the reward.
4:33 It took me a second to recognize it, but I’m glad you chose JORT STORM for bgm Edit: nvm slimecicle used royalty free music as the backing track lol
Incredible video, maybe the fastest a channel has gotten me to sub lately. Small piece of advice: when the subtitles and the hour counter are the same color it can look like "8 hours" is part of what you're saying. Like i said, very small and insignificant thing, but it was slightly distracting
@@aitango Hey how could I learn to build an AI like this? I follow the competitive cod zombies community and I'm curious about the potential use for AI clearing confusion with certain strategies (particularly on Shi no Numa). I've drafted a list of variables an AI might want/need and have decent game knowledge regarding BO1-BO3. If it might matter, while frames per second is known to affect movement mechanics and input frames in games like COD, the "server side" (which applies even to solo mode) runs at 20 Hz, so it might not be as resource intensive as it might otherwise seem just having the AI read variables at that rate. Also, low FPS can even be advantageous for movement in certain situations over high FPS. I don't know much about AI so I don't know how naive I might be about this 😅 but I would be willing to train it a long time if there is real potential for it to discover novel ideas.
What type of exact RL method did you use for this? Also do you modify the method or do you more or less implement it the way its coded in the papers? And do you have to do allot of hyperparameter tuning that we dont see or do you just wing it at the start and run it a long time? I really love RL allot and your channel got a instant sub, if im lucky you can maybe quench my curiosity a bit.
Not really a question but please read your own subtitles before releasing a video. I get that you used speech-to-text to make them quick, but proofreading shouldn't be avoided.
I’d also strongly recommend moving the hours trained display thingy away from the top row of subtitles. They’re the same color and everything, so often when reading subtitles, it’s quite confusing.
That would be interesting, it would probably take a little while to adjust since it appears to really like using the panels at certain angles, but may find it easier in the end!
New sub! Great videos... can you make a video on your hardware specs? What computer you use, GPU, cpu , training, do you use cloud services for training?
Thanks, great to have you around! Probably won't make a video on it, but here it is! This is run on my own PC rather than cloud compute, but was very expensive to initially buy. The GPU is an RTX4090, the CPU is a i9-13900k, and I have 64gb of ddr5 5600mhz ram. All of the mentioned parts massively speed up training. GPU allows you to do the learning (backpropagation) faster, the CPU allows me to run many environments in parallel very fast, and the algorithm im using requires something called an Experience Replay Buffer, which can use huge amounts of RAM (often far more than 64gb!)
I actually tried doing Wii Tanks a while back but had some trouble with it, but its something I want to come back to because I really loved Wii Tanks :)
I love this channel, I do wish the music was a lil less loud. I kinda watch these videos at night but still the music audio is a but overbearing in my opinion. I'm absolutely subbed tho!
The technique to learn is Reinforcement Learning, although it can take a while to learn if you are new to it! I don’t currently, but may create one soon! Also, I might currently be planning another video on NSMBWii haha
Thanks for the sub, glad you liked it! The AI and the CPUs work very differently, as the CPUs use quite traditional techniques (this game came out almost 20 years ago), whereas my AI is a self-taught neural network
Rainbow is pretty popular, only algorithms I see more often are probably DQN and ppo. It’s a very strong algorithm, but fairly complex to implement. Great for learning rl though!
Yeah I would love to do most things on Wii Sports, but sadly the defining the actions is quite difficult since they all use motion controls! Plus at the moment I actually don't have access to the controller's accelerometer, so can't perform shaking motions :(
I actually looked at doing this, but its surprisingly difficult! There are lots of different actions which really slows down training, but the biggest problem was that the AI bullets are really small, and the AI already has a very low resolution image to work with. Its definitely a problem I wanna solve though!
What do you mean by adding more CPUs? Also I’ve recently been looking into using bigger neural networks for my next videos! Sadly it does often slow training down even if it leads to a better result
Its really funny how the AI got so good at around the 16 hour mark that it forgot how to handle the ball spawning on its side of the field (which only happens after it loses a point)
Simple games seem to do an excellent job of showing the progression of the AI learning.
Yeah simple games do seem to give a really nice smooth improvement as the AI trains!
It really seems to love that particular angle of paddle. I mean, it does seem to be working, but still, it's really set on keeping it like that.
I think that's because that angle makes it really easy to squeeze the puck between the bottom wall and the paddle to get high-speed shots consistently. I know because I used to use that against my brother lol
At this point the best bet is to divide this base AI into two so that they can play against each other in two player mode. This way it can get as good as it can against any opponent, since it is just getting good against the cpu exploiting it's weaknesses; however, if you were to place it against a random player it might not do as well. Furthermore, it itself has weaknesses, so a separate AI exploiting those should teach it properly.
That's incredible. You gotta train it to beat that wii tank game now. I was never able to beat it even when cooping with my friend.
Wii Tank game would be amazing to see, but definitely a real challenge! Might have to leave my pc training for about a week to beat that one haha
my brain has been rotted when mania master comes on all i hear is jort storm
I like how it shakes around like it's celebrating
Love the fact you used Jort Storm by slimecicle in the background
Cool video! Gotta wonder what would happen if you put this AI up against itself though - would it just have a crazy endless game where neither would score or would it need to learn more before getting there?
Honestly I have no idea! Not sure if they would just become like gods and no one could score, or if they would get really good at directing their shots so the other player couldn't block them.
@@aitangoWell, there's only one way to find out!
I like how at one point you can see the enemy AI perfectly track the ball's vertical position. Then suddenly in the games it's so sluggish to react. It feels programmed.
Contrast to your ai, which looks like it's actually trying
The way the red paddle tracks at high speed looks so goofy
It would be interesting to see you also play against the ai in these videos
Idea: Put it in a shop and allow people to play it for free all the while collecting training data. Keep the existing training data as a starting point but let's see how well it gets against humans after a month. Or, rewrite it to play against itself in 2 player mode.
So glad I found your vids. Am having a wonderful time watching. Thank you again.
You should try adding a bonus reward for stylish flourishes and stuff
You should try playing against your AI!
Also, can your AI get the platinum medal yet?
Yeah that would've been entertaining, I might try that on some other videos. Is it 14 points to get the platinum medal? I might've gotten it while training a couple of times since it seemed to be close in most of the games I watched. Perhaps I should've let it train for longer!
@@aitango According to Google it's just 14 points. I wasn't sure if maybe it would penalize you if the CPU opponent scored, but I guess not. I wonder if it's possible to get scored on 14 times, and score 14 goals in the same game, and tie and still get a platinum medal.
Maybe your AI is the bot for the job?
Do you think, you could make an AI beat the Wii Play tank game, or would it take too long to train it, given how much levels can vary? Maybe you can have it learn just one extremely hard level in that game?
It looks like the AI's biggest struggle was handling when the ball wound up _behind_ the blue paddle.
Probably got nervous it would score an own goal
this is so good I folowed your videos now sinde 1.5 years and all of them get better and better.
Really glad you think so, I’ll keep at it!
Nice video man, it was very enjoyable. How did you get into coding? Im kind of getting interested watching your videos and wanna know more about it
Thanks! I learned a little coding in school when I was about 14, then I got really into making games so spend hours learning to code that way! I have mostly stuck to Python, but also done a couple of others here and there
@@aitango thanks for ur comment, ill look around!
I love this! Really interesting that the AI seems to prefer to hold the paddle at that 30 degree angle. I guess it makes sense because it gives it a lot easier access to hitting the ball in whatever direction it wants with only a slight change, given the circular end of the paddle.
Glad to hear you like it! Yeah I think it just gives that extra flexibility, and also bouncing it off the wall just seems better in almost every case than just hitting it straight
Would be amazing to see AI try and take on 2003 Strategy AI from a game called Rise of Nations Extended Edition. Those AI are absolutely brutal in terms of strategic skill if you have them set to toughest difficulty.
We need this to be open sourced!
mhmm
Oh cool I didn't realize you were VIPTankz!
I'm in the video 😳
I thought you knew about my channel! That’s cool if you came across it anyway though!
love how it looks like the ai was struggling with getting stuck on the walls cos the walls actually stick u in this for some reason. my mum always used to struggle with that lol
Can you play your AI? And how is this different that what the WII CPU is doing? Is WII CPU designed NOT to learn?
The Wii CPU is just following an algorithm, or set of instruction that do not change as it plays, hence it has no capability to learn. This AI however is able to modify itself to improve! Maybe I could play against the AI, I'm not sure if I'll do it for laser hockey for Mario Kart its a bit of a dream of mine to eventually do, and get the AI to beat me!
The Lazer Hockey turned into DBZ after 8 hours, very riveting to watch. I wonder how the Ai would do against another Ai like that? Maybe even a copy of itself?
That reminds me of when they taught an AI to play shooters and eventually they ended up never leaving spawn since the punishment was more likely than the reward.
4:33
It took me a second to recognize it, but I’m glad you chose JORT STORM for bgm
Edit: nvm slimecicle used royalty free music as the backing track lol
Incredible video, maybe the fastest a channel has gotten me to sub lately. Small piece of advice: when the subtitles and the hour counter are the same color it can look like "8 hours" is part of what you're saying. Like i said, very small and insignificant thing, but it was slightly distracting
It's cool that it learned to turn at an angle and bounce the puck off the walls!
Would love to see an AI destroy COD Zombies if that's doable!
Yeah it really mastered that shot! I would absolutely love to do COD Zombies, definitely be something I will at least give a try…
@@aitango Hey how could I learn to build an AI like this? I follow the competitive cod zombies community and I'm curious about the potential use for AI clearing confusion with certain strategies (particularly on Shi no Numa). I've drafted a list of variables an AI might want/need and have decent game knowledge regarding BO1-BO3. If it might matter, while frames per second is known to affect movement mechanics and input frames in games like COD, the "server side" (which applies even to solo mode) runs at 20 Hz, so it might not be as resource intensive as it might otherwise seem just having the AI read variables at that rate. Also, low FPS can even be advantageous for movement in certain situations over high FPS.
I don't know much about AI so I don't know how naive I might be about this 😅 but I would be willing to train it a long time if there is real potential for it to discover novel ideas.
i like your ai videos
I'm very glad you enjoy them!
Cue the funky music.
What type of exact RL method did you use for this? Also do you modify the method or do you more or less implement it the way its coded in the papers? And do you have to do allot of hyperparameter tuning that we dont see or do you just wing it at the start and run it a long time?
I really love RL allot and your channel got a instant sub, if im lucky you can maybe quench my curiosity a bit.
I want to see an ai like this fight another ai. Just to see how fast paced The game could get
The strategy seem to be keeping the paddle at a certain angle
Yeah it really learns to go for wall shots the cpu just can’t seem to handle
II bet you cant make an AI playing the first few levels of the panzer game in wii play
I’ll accept that as a challenge
Not really a question but please read your own subtitles before releasing a video. I get that you used speech-to-text to make them quick, but proofreading shouldn't be avoided.
Yeah I briefly checked over them but was still a bit asleep when reviewing them haha
I’d also strongly recommend moving the hours trained display thingy away from the top row of subtitles. They’re the same color and everything, so often when reading subtitles, it’s quite confusing.
now you have to play against it to see how good it is against humans
Wonder what the difference would be if you swapped the paddle to the G one since that's more circular than this paperclip paddle
That would be interesting, it would probably take a little while to adjust since it appears to really like using the panels at certain angles, but may find it easier in the end!
@@aitango Woohoo, more content!
i wouldent mind seeing a human take on the ai's from your videos
New sub! Great videos... can you make a video on your hardware specs? What computer you use, GPU, cpu , training, do you use cloud services for training?
Thanks, great to have you around! Probably won't make a video on it, but here it is! This is run on my own PC rather than cloud compute, but was very expensive to initially buy. The GPU is an RTX4090, the CPU is a i9-13900k, and I have 64gb of ddr5 5600mhz ram. All of the mentioned parts massively speed up training. GPU allows you to do the learning (backpropagation) faster, the CPU allows me to run many environments in parallel very fast, and the algorithm im using requires something called an Experience Replay Buffer, which can use huge amounts of RAM (often far more than 64gb!)
Would love to see Wii Tanks! done since it's a little more complex but shouldn't be too difficult to overcome.
I actually tried doing Wii Tanks a while back but had some trouble with it, but its something I want to come back to because I really loved Wii Tanks :)
@@aitango Awesome to hear, i hope to see that video eventually.
Awesome dude. Can you do 4k next time? small text is a little crunchy
I love this channel, I do wish the music was a lil less loud. I kinda watch these videos at night but still the music audio is a but overbearing in my opinion. I'm absolutely subbed tho!
I'll know my time on Rocket League is over when I see "AI's road to SSL"😢
Man, I'd love to make one for NSMBWii, how do I learn this from scratch? Do you have a GitHub for your past AIs?
The technique to learn is Reinforcement Learning, although it can take a while to learn if you are new to it! I don’t currently, but may create one soon! Also, I might currently be planning another video on NSMBWii haha
can you do pong ? it's even more simple !
The video is very old and probably much worse in terms of editing and stuff, but I actually have a video on pong!
BEAT IT, BEAT IT, BEAT IT!!!
Is that the feken jorts song in the background lmao
how did you make it learn so fast
Cool vid! I wonder what is the difference between CPU and AI. Also new sub!
Thanks for the sub, glad you liked it! The AI and the CPUs work very differently, as the CPUs use quite traditional techniques (this game came out almost 20 years ago), whereas my AI is a self-taught neural network
I swear I need to learn AI just because I don´t got any friends to play wii games
I dont see many things about rainbow dqn, why did you choose it and do you think it is a hidden gem or is it more used then I think?
Rainbow is pretty popular, only algorithms I see more often are probably DQN and ppo. It’s a very strong algorithm, but fairly complex to implement. Great for learning rl though!
it's possible that the code to screenshare is slow or laggy that it is slowing down the ai?
I need a game between to 24 hours AI paddles 😮
So this is what they mean by video games cause violence
Omg the background music is fucking jort storm 4:23
Wii sports golf would be cool
Yeah I would love to do most things on Wii Sports, but sadly the defining the actions is quite difficult since they all use motion controls! Plus at the moment I actually don't have access to the controller's accelerometer, so can't perform shaking motions :(
@@aitango cool and i did not actually expect you to respond
Tank minigame?
I actually looked at doing this, but its surprisingly difficult! There are lots of different actions which really slows down training, but the biggest problem was that the AI bullets are really small, and the AI already has a very low resolution image to work with. Its definitely a problem I wanna solve though!
You should have cloned the ai and make it play on the other side as player 2 against it self to get even better 😂
great. if you could add more CPUs and make it larger will be better + more training
What do you mean by adding more CPUs? Also I’ve recently been looking into using bigger neural networks for my next videos! Sadly it does often slow training down even if it leads to a better result
@@aitango I think they mean running multiple instances of it.
@@aitango multiple bots against the ai
How do you make the AI
*Promosm*
?
Now you play the ai!
You should play against the AI yourself to see how it fares against a human opponent.