How "Smart" AI (Basically) Works in Games (Goal Oriented Action Planning)
ฝัง
- เผยแพร่เมื่อ 29 มิ.ย. 2024
- In this video, we look at how simple AI systems work, and how we can create "smarter" AI that create and execute plans. We'll learn how to code a modified form of the GOAP AI in a future programming tutorial.
This month's dev challenge theme is artificial intelligence! Head over here for more information: / game_dev_challenge_art...
My second channel! / thehappiercat2
Ask questions in the subreddit: / thehappiemakers
Find me on Twitter: / thehappiecat
Or Facebook: / thehappiecat
And sometimes Twitch: twitch.tv/happiecat
Resources from this video:
Jeff Erickson's Algorithms Notes: jeffe.cs.illinois.edu/teaching...
Jeff Orkin's GDC Paper on F.E.A.R. and GOAP: alumni.media.mit.edu/~jorkin/g...
Food example adapted from this repository's implementation of GOAP: github.com/sploreg/goap
Behavior tree diagram from: www.gamasutra.com/blogs/ChrisS...
Gameplay clips used from TH-cam users: ElectroEthan, Dante XII, NintenU, World of Longplays, SaikyoMog, Seanleeuw
I do not own resources used in this video. They are used under fair use.
Stay happie :) - วิทยาศาสตร์และเทคโนโลยี
So you are telling me that back in time, when i was playing Resident Evil 3, the logic behind Nemesis I.A is: Find the player and heck the sht of him no matter what.
And that simple logic became my worst fear when i was teenager?
GOSH!
lol
But..... he wasn't allowed in the save location!
Interesting videos - i've subscribed
hy! i watch your physics videos
look who we got here
TOBYYYYY!
So that's why the AI in Age of Empires freaked out once when he didn't find any wood (whereas a human mind [me] managed to keep going).
Sounds to me like the AI's search parameters were set too small.
Also Crusader: you could buy missing resources from the market whereas the enemies used it only to sell things...
Age of empire was before of goap
just found your channel few days ago, and really love much of the content :)
I thank youtube recommended for this. For once they show me someone worth subscribing.
Yeah this shit is great. I'm a senior computer engineering student but I've always been passionate and interested in video games. This channel is heavy on some of the most interesting subjects I've learned in my degree and helps fill in some of the blanks that my pet games are missing. I can code C/C++/CUDA very well but I had no clue about how to actually display anything aside from text.
Fear was the first and the only since game where I noticed the AI improvement. I was actually impressed.
Stalker: Call of Pripyat Complete Mod's Wish Granter feature is great for spam spawning NPCs and watching the ensuing battles. They really feel like they have a spark of life in them. images.akamai.steamusercontent.com/ugc/594727976632674936/0666A1FD32BF2AEEF5B2C71149775BA9640B300A/
this helps me understand the Elder Scrolls so much more, especially putting the excuse that NPCs weren't allowed to transition cells because the NPCs kept on murdering people when that could have a requirement of "Morality
Im not used to comment a lot on TH-cam but I have to say it. Personally I like the way you make the videos easy to understand, how you take your time to help others learn or clear any doubts. Very pleased with the reference and the recommendations. Keep it up! :)
Watched a couple of your tutorialish/explanation videos so far. Including "How does combat work" and "how does AI work". From what I have seen so far, I have really enjoyed them. They aren't really a do it yourself tutorial if that's what you are looking for, but a very clear, layman, general explanation. She doesn't just say some random tech words or jump between 6 different thoughts and topics with in the same sentence. Does a good job of speaking as if the viewer knows very little about the topics being discussed. It's really great that she includes clearly done, related diagrams/drawings, that are perfectly insync with the explanation. Unlike most TH-cam tech/tutorial videos that do little, but show pre-made, near expert level work. Whos main focus seems to be more intent on impressing the viewer. Your simple approach is very refreshing and enjoyable, making it almost seem easier to get lost in the topic. She did such a great job of teaching. That despite learning nothing but absolute, beginner level information. I left with the feeling that I could easily explain these concepts to someone myself. Instead of being so bogged down and overwhelmed with new information, I could barely remember it myself. Let alone explain it again to someone else . Which is the normal result of a TH-cam "tutorial" video.
I would guess the channel owner has some sort of professional experience in the fields of teacing, public speaking or tech?
If not, she would be very good at it.
Thanks for the great videos and explanations!! Keep them coming!!
Currently working on an AI this helped a lot and gave me some new inspiration. Cant wait to test it out thanks :)
This was amazing! Seeing a video paper on FEAR really made my day. It is my all time favourite game.
This is a fantastic video explaining a bunch of things I've learned the hard way over the years. Very cool that you condensed it like this and explained it so clearly. :)
I just found this channel today. these videos are great!
Your channel is fantastic! I don't understand how you don't have more people watching every episode. I'm currently going through java and c training, and this kind of thing is great for my java course!
Hiya HappieCat! It's EpicKnight999, and my game happens to already have AI programming in it. I totally loved the goal-based programming video you just made, and eagerly await the chance to beef up my AI skills in the weeks to come. A note to other programmers interested in this new challenge, AI and path-finding is certainly some difficult stuff for even a great programmer to code in, but robust bot units are often the most important parts of modern games. A* path-finding is a great, versatile way to setup heuristic path-finding for AI, and it's explained very well by Cherno's Game Programming videos. I just wanted to say, I love your videos and will be fully prepared to submit my program for this next game challenge (no week-long programming sprint). :D
Thanks for sending your project in for last time! The video should be up soon. Hope to see people tackle some challenging AI projects this month.
Thanks so much! I've been working on a goal oriented AI solution for a couple of hours, and derived the goal system you talk about but hadn't considered evaluating each action as a cost. Instead I was only thinking about benefits, which was tripping me up. The resources you've linked look really great. Much appreciated :)
Would you consider discussing machine learning in a further video? A lot of what I've seen online seems pretty... narrow... for lack of a better word.
Thanks again :)
Fantastic video, explanation and attitude. Keep up the great work.
First vid of yours I'm seeing, very cool! This is the type of stuff I do daily at Blue Sky Studios for films; flock and crowd systems, programming triggers to switch between states in a stack. All very useful info to learn when it comes to basic AI, all the way up to neural networks. Keep doing your thing!
Interesting topic in an easy to understand format. Kudos!
Horray, you're back!
I'd been looking into GOAP recently, and I feel like there's not a lot about it in depth (except maybe only for Jeff Orkin's book?), but I'm hoping to implement it anyway!
Been learning diffrent programming languages but decided i shold think of bigger concepts instead. Really enjoy the content and links thank you.
this is a really nice collection of tutorials
Thanks you for this +TheHappieCat
Nice explanation of state machines, love the cats everywhere :)
I'm going to school for programming this January. I've learned a lot from your videos. Thanks for sharing your knowledge!
Very nicely explained. Thanks!
Super interesting video!! Thanks for posting it!
Hi, just to say excellent quality video and you simplified it perfectly. subscribed.
I think I like this channel, subbed :) You can never have enough detail with me personally, lol.
Amazing video :D thanks for giving us that kind of awesome education :DD
This video is absolutely brilliant. Thank you so much!
I'm studying information sciences in the university and you have earned yourself another subscriber with this video. Congratulations!
I wrote a GOAP Ai for fun a while ago, and let it plan some tasks at my work. When a new colleague asks for how something is done, i could just enter the goal and current conditions, and let the ai spit out all task-steps in detail. It was more of a fun app, and not really needed for productivity, but funny to have the computer generate a list. (Using A* for the planning)
You made this super easy to understand, good job!
hmm, first video I watched on your channel, I subscribed. I didn't even know this existed gj! I'll probably go through every single one of your videos, I mean it's better than watching Netflix because I'm a Software Engineering major so I;ll actually learn something. Honestly gj.
just saw 1 min of this video and subscribed right away!! awesome vid
Pretty good explanation of GOAP! Nice job. I'm going to tell Jeff about your vid :)
Thats just what i was searching for. Thank you very much :D
honestly when you started to draw cats, I just changed my state from "I wanna watch it" to "quality material is false" but you successfully managed to change state back to true.. well done :)
I have to say. I just got done taking my intro to Artificial Intelligence class (and happily was successful at passing) but I really which i would have found your videos earlier. They're a lot more enjoyable to listen to and makes the ideas about x100 more clear than my college professor.
Hi and thanks, got enlightend a lot pretty quickly :)
simple AI-like things are much easier that I expected
Great video, exactly what i was looking for
Great video. Thanks for posting. :)
Great video. Simple explanation, just the way I like it. Your pictures of cats are lovely.
Hey Happie Cat you make awesome videos and I like the way you explain everything and you make everything simple.Thank you for every video you make and I hope that you will continue! ;) (also if someday you create a game be sure I will support you)
greetings from mexico anne. im just about to start studying software engineering and im a little intimidated by the maths aspect of it but your videos are one of the things that have motivated me pursue it. thanks for the great content!
That's awesome to hear! Good luck at school, you'll be fine.
may you do more on AI?!?!?!? love your work
Math will be a part of the courses, but later in work life you'll be surprised how little math is involved. For the most part it's just knowing how algorithms behave, how long they need to terminate. That's usually quite simple.
I love your videos! I'm just a lowly modder and I have no idea how actual AI systems work (or heck, actual, complete game engines and programs, for that matter!). These are so easy to understand and serve as an excellent "baby step" to developing all kinds of cool stuff, and they also never fail to be entertaining as well. =)
Can't believe I haven't found you before now. Subbed
Erik the God Eating Penguin same thing with me
I have no idea about programming etc. Just randomly found this video. I must say you know to explain stuff. Well made video :)
I have no idea why this was in my suggestions list but I'm glad I watched it, I learnt something!! Woo!
Just found this channel, fantastic video!
Thanks for the vids!
First time here on your channel :) It was a nice video, I've learned some new and I really liked the cat in your sketches haha xD
This is really an interesting channel. Keep it up! thanks
New to the channel really like the in depth stuff :)
Thank you, very interesting and excellently delivered.
I can't believe it...
I typed a random search & found a great video immediately.
This is amazing.
I always loved the Ai in Fear I'm so glad you mentioned it here.
Dat programmer art, though.
This is a banger video
I feel like AI is the hardest thing to make in games (in terms of programming) but most game dev videos are on implementations
Thanks for the link to the Algorithms Notes , it's just what I've been looking for.
I have MIT's "Introduction To Algorithms" , but it's a bit over my head. This one looks like it explains everything a bit more on my level.
Thanks a bunch
Don't forget "Introduction to Algorithms". It's very useful, even if it seems over your head right now.
Great content, great vídeo! Thanks!
This was awesome! thanks.
I am currently trying to filling the void this channel seems to fill: Talking about game topics in depth and in a practical sense. Any other channels that do this? Extra Credits is fine and all, but they talk more about Ideas than the actual practicalities. Just hearing about GOAP was a big win for me.
That was Really interesting. Thank you for sharing =)
I've just started a Tic Tac Toe game in C++ that I can hopefully add AI functionality to before the end of this month (After I make sure the initial game with multiplayer is set up and working)! I am going back to school in August though, but I really hope I can finish this and send it to you! Have a happie day!
Well, you'd like to check the "Minimax" algorythm... It's vary handy for those types of games (including chess, checkers, etc)... It may become a bit that heavy on the processor though :P
Wow. Thinking of decision making as pathfinding in possibility space is a little bit mindblowing, and really cool.
I have played through dark souls two quite a few times, and I like how you described using animations to visualize these actions. with the addition of npc or enemy home locations, its helping me understand the ways that the npc and enemy AI work to create the experience.
For example'; I had been stuck on "the rotten" for quite some time during my initial playthrough, but through trial and error, I learned that he was reluctant, or refusing to do curtain attacks when I was in curtain positions in his arena depending on my proximity to various parts of his hitbox.
Now I understand it was likely because i had not met the requirements to make that action take priority over other possibilities for completing the goal of eliminating the player.
When I think of it in these terms, it really makes me think about even more possible strategies if I can use this system of AI to my advantage as a player.
Thanks for the rundown of how all of this works. It really changed the way i view my actions in PVE games. definately subbing.
i didn't skip the ad to support u and see more videos from u
Great video!
the first worthy overview of game AI I found after 2 years of gamedev
Wow what an amazing video! :D
Great stuff, new sub. Thanks!!!
Thanks for the video, that was excellent!
Very cool miss cat! I did shared it and liked too. More successful, lady!!! :D
This is really interesting, thanks.
Love all your content :)
Nice, i was using enum state machines, now i am understand more this.
This video is awesome! Thank you.
enjoying the video. FSMs are very important to programming, but I never coded up an AI to date :)
Awesome!
This was a very good video. I'm really glad that you mentioned F.E.A.R.'s AI system. I think that it is a very good system. While I haven't had time to read through the whole paper yet, I can imagine that it's a good read.
I have mostly programmed the "Finite State machine" or branching AI, despite not having read much about it. (probably since it's more easy to program)
However, I've been thinking of maybe trying out the GOAP method.
What I've been wondering about is that maybe the smartest AI isn't always the most fun AI?
I remember programming a pathfinding AI for a 2D platformer, but when I looked at what other successfull games did (for example Shovel Knight, Super Meat Boy), which didn't have complex AIs and were still concidered good games. (it's kind of what you were talking about at the end of the video)
I just want more complex and smarter a.i. for games that need them like rts and sometimes souls games. Especially rts. Harder difficulty a.i. usually isn't coded different, just given cheat resources and they called it harder, when its just cheating and not proper difficulty.
I have similar interests and sadly the good cases are few and far between. I recommend checking out the HD version of Age of Empires 2 (of all things) for a good example of rts AI. They rewrote the entire AI using multiplayer tactics and made it unable to cheat. It is now significantly harder than the original cheating AI and beating it on hard requires much practice. It is very interesting to spectate a mach between the old and the new AI in this case and see the differences, something you can do via standard singleplayer skirmish
@GepardenK @Alchemical Games
I agree with GepardenK, this is exactly what they did in AoE II HD, and it seems to have created a very efficient and well designed computer AI player. Just if you use the multiplayer, download voobly, they usual net code isn't exactly the best without it.
I actually bought it a while ago and played it quite a bit.
But the unit moving and a.i. is just horrendous. Truly, awful. Not as bas as starcraft1, but pretty bad.
And they also didn't really improve the graphics very much, just made it ever so slightly better but not good enough to be called an improvment in my book.
I play it from time to time, but the unit movement and just complete failure at intelligent units puts me off and i just can't deal with it for any extended amount of time.
Alchemical Games
Pathing may not be the best, though much of this issue stems from the HD version being locked to 30fps (or 20?) - making the game feel very clunky to control. Voobly version does not have this issue and controlling units feels much smoother as a result.
That said it is still worth to analyze the enemy AI in the HD version. By that I mean how they build bases and play the game generally. You don't need to control anything - just spectate them. It does not cheat at all and is extremely effective. Good luck beating it on very hard
I'm just not gonna bother with something that doesn't respond and act like it should just to appreciate something like how the enemy builds it's base, sorry friend
I don't, yet, know how to code. But this logical breakdown of paths is really...logical to me. Thanks :)
I just found this channel today, seems pretty cool.
Great video. I wonder if you could do one that expanded to discuss topics salient to grand strategy and tactical squad types of games? Or are the principles you discuss here more or less identical for those types of games?
first time watching one of your videos, and as a games dev student with particular interest in AI, i still found this informative.
+1 sub :)
P.S. what is your second channel?
Cool to see another game dev student :D
I do find learning about how these types of things work pretty interesting but I have no interest in actually making them. I am pretty horrible when it comes to working with numbers and letter. When I see a blank slate for coding I look at the slate, the camera jumps to make a close-up of my face after staring for 5 minutes and my face has become that same blank slate... I draw blanks when it comes to coding.
Good thing I am able to work with images and 3D work Xd, maybe some visual scripting here and there but actually writing the code would frustrate me to no end, speaking from 5 years of math, science and physics and 2.5 years of game design experience xD
anyone can code, brother! it just takes practise! :)
Tidy Tate I could do simple things but advanced things aren't for me. My brain does not really work like that. I have tried...
like i say man, it just takes practise! no-one is a natural coder. no-one naturally thinks in code. it's abstract and weird and time-consuming and frustrating. but if you put the effort in to learn and to try and to make mistakes, it does pay off!
I would love to see video dedicated to Behavior Trees. FSMs are easy, but I've bought AI plugins for Unity that use Behavior Tree and I just can wrap my head around it.
Thanks for the video =)
Utterly fascinating :)
Omg those algorithm notes are fantastic. i wish i knew about them when i took my algorithms class last year lol.
I wanted to know why AI is really good at making/using a "counter play" against the player, this video was very helpful.
The most advanced AI to date, Iron-Knuckle Zelda 2
Stalfos in OoT were also smart as hell.
Nothing beats the Dekubaba AI!
The guards in GoldenEye 007 put everyone else to shame.
Laurelindo how about the Google ai that can Chat in Twitter...like normal people and changes its behaviour opinion and charakter based on the interactions?
(i didn't read too much about it, but they had to take it offline after one day, because trolls turned it into a super aggressive Nazi ^^)
dylanjantz1
well i guess that wasn't how the test was supposed to go, but atleast it worked :D
Haven't coded for ages, as I have no patience for it, but I'd kill for this kind of explanation back in the days when I tried to figure stuff out. OP should be teaching classes in real life.
Love the fact that you wrote smart between quotation marks xD.
interesting, continue like this
Studying C++ now, and in a one little moment asked myself, where is that Happie Cat with her videos? After one second my phone notifies me about one unread mail. So I open my inbox and next question I asked was "wait... WHAT?" It was TH-cam subscription email with your video! How can it be? I don't believe in some universal power of thoughts, but... HOW? Just one second and my question was answered. Wooow! BTW, thanks for your another vid, it's pretty useful for me now! And hello from Belarus! =^..^= Meow!
Haha, that's great! I have a few friends in Belarus, hope all is well :)
Hoi Ok, if you want a partner to learn c++ you can tell me. I'm learning too with the old and good Bjarne (':
You can do what Zelda 2 did for some of the A.I. The main code was to get into attacking range of the player. Once in range the movement, attack, blocking, and jumping was heavily reliant on the inputs on the controller. The more aggressive the player inputs the more reactions happened via A.I.
Nice thing you started with F.E.A.R. and mention it so much, that's pretty much one of the only games (game*.. I don't think the ones that came after the first still had such a good AI) where AI is actually good and works, in most other, even "modern" games, the enemies just frigging blindly charge you or at best take some cover and shoot you from time to time... The other ones come down to S.T.A.L.K.E.R. (the original that is, not the one that came out, this one had its AI cut down significantly), and maybe a few others i forgot about.
Thank you!
YOUR VIDEOS ROCK! THANK YOU!
0:21 Omg I just finished playing the original FEAR yesterday, such a good game