Want early access to new videos and some behind the scenes content? Consider becoming a channel member th-cam.com/channels/QvW_89l7f-hCMP1pzGm4xw.htmljoin Other videos you might enjoy: th-cam.com/video/DvJLIWAGno4/w-d-xo.html th-cam.com/video/ILY7tYdIS2Y/w-d-xo.html th-cam.com/video/_2GObcrrWq8/w-d-xo.html
It felt like you only just got started! As others have said it would be appreciated if you make these videos longer, and maybe even a part 2 of this video where you go further would be amazing!
Responded in another comment but I basically don’t know how long a video will be till it’s done. Always looking to experiment with different video lengths though
@@nathanbaggs I'd vote for longer/more detail, or alternatively devote several episodes to a *much* deeper dive into a single game: off the top of my head, now you know how the AI gets its broader instructions what happens if you fiddle with them, how does it decide how to *implement* the instructions (what does it prioritise, how does it cope with resource shortages, etc.), what makes it decide when to go on the offensive, why did Geoff decide to go on an expedition, what strategy does it use to expand territory and explore the map, how does it select its targets in combat, is there a way of exploiting the AI, etc. Obviously a massive undertaking as it requires reverse engineering almost the entire game, but it would be fascinating to watch the process.
@@elbiggus Yeah like 30 mins. You figured out how the file works, now you need to test your hypothesis by building new ai files with strange or fun behavior.
I worked at Microsoft when AoE was being developed. My team would play the daily build at lunch time with 8 player games. We had access to the source code and build files. One of the employees created a custom version for us, making some improvements like unlimited population size. Once in a while we would crash the game since it was still in beta and we were pushing it in ways it wasn't designed. We had access to the daily builds of all software so we could try all the games being developed. We all got into Monster Truck Madness for a short time. I reported about 20 bugs that I found and got a thank you email when it released. We were playing truck soccer, and suddenly we each had our own version of the ball that the other couldn't see. A head on collision at the peak of a hill sent my truck into the sky only to get stuck there. Another time I reached the border of the map, and got stuck there too.
The AI in AOE1 is controlled by 3 files. The AI file lists the build order, PER their general behavior towards what they've built and towards other players, the PLY file defines how the AI attacks other players. The AOE Heaven website have guides for each file, but they're not all-encompassing since the AI wasn't publicly documented, it's sourced from modders and what they could find.
@@king_james_official The story of life is people repeat a lot of what other's have already done, but the exciting part is giving it a try on one's own. ❤
While already discovered before, documenting the research process as if it had not been done before is still very educational and I'd love to see more!
I really appreciated this video Nathan. When I was about 10 years old and first getting into computers and I had access to this game. Curiosity drove me to try and unpick installation files in notepad but obviously didn't get anywhere. 20 years later I'm an IT professional and write software and for a living. The desire to learn how things work has not gone away. You've made the process of reverse engineering software as accessible as I think it can be, which is an real achievement, well done!
Love it when people try to reverse engineer stuff in old games. There's a guy that spent years working on a 23-year-old WWII 2D real-time tactics game of which the source code was lost to time, and he managed to get modern screen resolutions working which nobody in the last two decades managed to do successfully (the game was hard coded with a crappy resolution with square aspect ratio). The difference it made was absolutely huge and it works flawlessly.
@@ErtugrulK Sudden Strike (1999-2001) and its expansion pack "Forever". The author has videos on it on TH-cam, HD mod it was called I think. Was a popular game back in the year 2000 in Europe, tons of mods and thousands of custom maps, but until 2022 nobody had ever managed to get higher resolutions working. Even the company which bought the rights to the IP years ago said they were unable to find the source code for the original games.
One interesting AI quirk is in the original Dungeon Keeper. There's a map where you're pitted against an AI keeper, rather than heroes. If you spend too long building your dungeon, the AI keeper essentially just runs their own dungeon into the ground and all their monsters leave. You spend you're time building and training the perfect army to take them down, and when you're finally ready to go steamroll in and take them on all you find is a husk of a dungeon with a load of empty rooms and maybe two or three flies.
Really interesting reverse engineering! Especially the reveal of “this can’t happen before that”. It’s been 25 years since I did this kind of things and I’ve forgotten a lot of my tricks, so it’s really nice to follow along.
Yeeesss! This is the type of content I love from you Nathan. Take a game, and do a walkthrough analysis of exploiting it. Amazing, hope you can do more, and in way more detail!
This is way above the level of programming I know how to do but it's very interesting to watch someone try to figure it out. I've played a lot of RTS games and used editors for those that had them and one of the things that really stood out for me about AOE was the fact that they had all of these descriptive names for the different AI scripts that specified civ and bulid order in the file name. I was confused when I started working with other games and was only some kind of "default" AI. Makes me wish more games would include some kind of more detailed AI script editor with their map editor.
This is great content. The format of walking through your thinking process and working through reverse engineering something is a great way to teach and get people excited about this subject. Thank you, keep it up!
I am experimenting with video lengths. To give an insight into this particular video (and the challenges around it), I spent about two weeks doing all the reverse engineering at which point I looked at my notes and could see the story I wanted to tell. It felt like a lot of content but I don’t really know the video length till I spend another two weeks scripting, filming and editing. Basically I don’t know how long a video will be till it’s done
@@nathanbaggs This would have been better if it was about 50% longer (assuming you found the content), but every viewer is different. I know this felt a little short for me.
Will certainly be playing around with different video lengths in future videos. Like I said I looked at my pages of notes and thought I had loads of content, but it all edited down to this
This has the same vibe as watching National geographic on those investigation and historical shows. Had fun watching this video and hope you do a series of this. The end results does not matter, it was the vibe and the journey that was entertaining
2:31 I listened to this bit 7 times to eventually get that it was "ProcMon" and not "ProcMutton". Also yay for Zerg rush; my uncle used to play AoE2 and was pretty good against the CPU but got trashed in online play. I was watching him do an online match once and he explained how everything would seem fine for about 5 minutes, then it would happen. Sure enough, a few minutes later his base was swarmed by an endless stream of cavalry units, followed rapidly by a loss. [edit] BTW I really enjoyed this. I might suggest one tip if you haven't tried it already: to make life more enjoyable when doing the "window dance", or for setting up a new game exactly the same way many times, it's worth automating with tools like AutoHotkey or AutoItScript.
You have also got to think about things like player interaction. Like if you went over and destroyed their barracks, they would need to replace it to continue making troops. That 4th column definitely looks like it's where the action needs to be done. -1 just seems to be like universal, placing buildings etc which you wouldn't need to click on something to do. Whereas Man is 109, which looks to be the TC, and archer is 87 which looks to be the range.. Pretty cool tbf! Would be very easy to tailor the instruction set to difficulty by just making the build order absolutely perfect or making it terrible haha.
I only reverse engineered the cracked version not being properly cracked back in the day. Fun-fact was that the RZR version was like 30 megs and contained the full game, while the full with CD was much bigger (also when installed I think) so I preferred that. However they only seem to have cracked for single player and multi did not work so I did it with softice, HIEW and some other similar tools. How great days they were - good to see people still do these kind of stuff 🙂
@@nathanbaggs I did reverse GT97 Racing though - because all version online are buggy and the time for checkpoints go too fast - but its a smaller game and dos game - likely my latests achievement in similar vein but smaller than looking around the AI of a game... Interesting finding there was that one can actually use dosbox as a debugger for smaller games and it eases a lot 🙂 I know there are people who reverse still - but always nice to see. There was this russian guy who created awful lot of DLLs for making games run over opengl instead of DX and often helped them work better on linux for example.... many great people - just never saw ai reversing before ;-)
It is easier to debug a game or app that uses DirectDraw to run in fullscreen mode on a 2-monitor setup. You use one monitor to run the game and the other one to debug. Alternatively, if you have 2 computers, you can use the remote debug feature (run the game on one computer, and debug on the other one).
You make it look easy. I tried to reverse engineer a 1mb command line program using Ghidra and it was too hard (1 yr later the company open sourced it anyway).
@@nathanbaggs as a programmer very unfamiliar with reverse engineering, it would be cool to have a "behind the scenes" as a separate video to see how you tackle problems (all of the ways in which you've been banging your head against the wall lol)
I find that technique where you decompile the whole exe and then search for a particular offset in order to find where a member variable is used really interesting. A couple problems I found with that is that first, sometimes the decompiled code uses for the same member a different type cast, so 0x160 cast as an int becomes 0x580 cast as a byte (4 times that value). Second, how do you deal with low offsets, which are super common (e.g. 0x08)? I'd be awesome if you go more in depth with this topic in your livestreams. Thanks for the awesome vid!
Is it still possible to create a map hack on age of empires 3 definitive edition still today? Even tho the game got a lot of patches?, and are you planning to get into age of empires 3 after you're done with aoe 1? Thank you for those videos, im just getting started
If you would like a challenge you could attempt to get the players colours from game memory in Company of Heroes 1. I've been trying to do this for a while and its hard because the colours appear to be assigned by slot order when start positions are fixed but some kind of random algorithm when the player positions are set to random.
the person who wrote userpatch for aoe must have done a fair bit of reverse engineering, because he managed to enable modern resolutions, increased population, update and improve ai capabilities, and fix many bugs in the map editor. interesting to see the tools used. can they generate c as well as asembler?.
would be great if you could find a way to make the game "TechnoMage" completely fullscreen, because it runs on modern computers only with a visible title bar on the top. That german game is very underrated and beautiful.
I’m so glad (and a bit teary eyed) to see the O.G. AoE…started with this in 2000 maybe and then found AoE Rise of Rome Expansion Pack. Brings a lot of memories. I still play it with my brother on Steam. And no offence but I’ll never be a fan of another AoE variant. And btw, great work on the back tracking
Very entertaining. Do you think you could do an analysis of this sort for Pharaoh: Cleopatra? The games are similar, but Pharaoh is really quirky in a lot of ways.
That’s a good point, sorry I glossed over it. Ghidra has an “export program” option that allows you to save a new copy of the binary with the modifications
@@nathanbaggs ahhh awesome, thanks for clarifying. In your defense, you’re the only one who answered this question which I’ve posted on several rev eng vids
I've watched a couple of your videos in total awe, although i ha no idea what you are talking about or what you are doing. Your knowledge impresses the shit out of me. I'm so jealous.
Hey Nathan, I would like to suggest another game to reverse engineer, and build a resolution patch for, Peggle. LOVE playing the game, HATE the resolution it runs at in windowed mode. It would also serve as a great tutorial for me to apply this info to develop personal patches to further games, such as the other versions of peggle, or sonic and sega all stars racing (While the resolution is nostalgaic (seriously IDFK how it invokes nostalgia for me lol), I want to use the full 1080p resolution of my monitor)
I've been a programmer for over 30 years and I'm still not even near the debug-magician Nathan Baggs seem to be. I feel like it would really up my game, but there's so many new things to learn too. =)
I've been playing the original AOE since its release in 1997 (last time I played was 2-3 days ago) and I never knew there are AI files in the game haha. I never checked. Interesting.
What a banger of a video, enjoyed the way you've dissected the code. It was straightforward to follow, well done :) Just gonna request if you could do the same for BF1942 because why not?
This is a fair comment (and one others have also said). The issue I face is that there's no clear correlation between time spent doing reverse engineering and length of video. This was about two weeks of RE effort, which I thought was enough to tell a story. But by the time I scripted, filmed and edited this was the length of video that fell out. Just a behind the scenes insight - I'm always experimenting with content length and type
@@nathanbaggs Yeah, that's fair enough. I guess you have just hit the right formula to get our interest and we're demanding more because it's easy for a viewer to assume you should be making content every waking hour!
Almost all screens were 4:3 back then. There were barely any customer models other than 4:3 hence why you only need one value for the resolution. The 800x600 automatically was chosen when you chose 800. Is this some very minor optimization?
@@vast634 That's what they do, there's a video of GOG where they explain all the things they do, it was very interesting watching that. I guess you can find it on youtube.
I would love for you to check out the code for Full Spectrum Warrior, Idk just for fun, I like these videos so much for some reason. Oh and Ghost Recon as it's main menu resolution is "hard coded" which is so low it makes it unplayable on some monitors.
I hate that thing with debugging a fullscreen application in the same computer because of focus. I always use remote debugging for this reason, usually I run the debugee in a virtual machine.
@@AEGISAOE but the "ai" would always decompile some instructions incorrectly so the decompiled code would not compile down to the same machine code. Thus making it useless. And what is the need for it when the available tools already do it correctly?
It would be awesome if someone could show how to do this sort of thing (windows exe reversing) alongside wine on linux 😉(though I really should probably just look it up myself at some point). As a bonus you wouldn't have to patch the app to stop it from forcing focus or a resolution globally for all other apps.
Since this game just uses normal window with WS_POPUP how much effort would it be to create open-source windowed mod? I know that there is high resolution mod out there but I don't like the idea that I have to download closed source thing from some random forums. Would be cool if there was open-source dll that you just inject into game and it made game window be freely resizable with optional alt + enter fullscreen. Of course I don't want to wast your time so if it would take weeks to make don't bother yourself with actual implementation just because this random youtube comment.
I've always wondered why Microsoft chose to name mangle basic functions by adding an underscore. I suspect it had something to do with not wanting name conflicts with kernel functions, most of which don't use an underscore, but I guess I'd have to ask someone from Microsoft that question. However, it is odd to me that Ghidra wouldn't automatically correct that name mangling.
Hi, wondrous job. Just i think you partially reinvent the wheel. Check out "How the AoE2 AI Thinks (ft. Promi)" by Spirit of the Law. It breaks down AI concepts of AoE2, sure it will be different but some parts might be similar enough so you will not start from 0.
Mr. Froddo Baggens of RE, why not you use your Ring on Starship Troopers, the 1st old RTS one, you command like 10 soldier with different abilities, in 3rd person; the thing is, the game will just bail, sometimes not even a error message; there's a specific mission I remember that will trigger this probably: is a mission where the Engineer, in a 'Mech Suit has the unique opportunity of all the missions, to deploy as many land-mines as you can set, you'd be alone, so be careful, and when deploying like 500 of them, the game crashes, other missions also have unknown limitations like that. Also DID F-22 ADF when you go at the right edge of the map, it'll exit without error, you don't actually get to the edge, but very close to trigger the exit. If you could fix these and increase the capacity of the buffers, or whatever gets overrun, and teach ud how to fix it, would be great and have our eternal gratitude
I once tried to extract the sprites of this game for fun, all these sprites are store in SLP files, these binary files are not compressed, it's not difficult to read and extract the data if you know the structure.
You remember Tormentium? He knew everything about this game. He tore it apart and built an online hack for it back in the 90's. Spoiler Alert!!! I beat him 1v1 while he was using hacks once. Up a hill in ArcherWar. If you know you know. Among Koren 9 year olds, my stiff old man hands are legendary. There's nobody on this planet who's played AoE online competitively that I haven't beaten in a 1v1. I was always too SLoW for em. The way the script works is there's a base behavior for the starting villagers. They always build houses, a storage pit, and then prioritize between fishing, berries, or hunting, based based on the map seed. The script changes based on local resources and map placement. THEN it goes to the Civ specific AI. The map seed determines most of the behavior prior to the development of civ specific buildings and units. Little shortcut from back when there were no clear paths to begin with. I sacrificed the print on many a keyboard and put a few thousand miles on some mice to this game. Good stuff.
Can you please take a look at the unit pathing in Age of Empires 2 DE, and identify the pathing algorithm? It has been a hot topic in the game community for at least a year
![TheViper Faces A Defensive MASTERPIECE [AoE4]](/img/n.gif)
Want early access to new videos and some behind the scenes content? Consider becoming a channel member th-cam.com/channels/QvW_89l7f-hCMP1pzGm4xw.htmljoin
Other videos you might enjoy:
th-cam.com/video/DvJLIWAGno4/w-d-xo.html
th-cam.com/video/ILY7tYdIS2Y/w-d-xo.html
th-cam.com/video/_2GObcrrWq8/w-d-xo.html
THEY need to hire you for aoe 5
It felt like you only just got started! As others have said it would be appreciated if you make these videos longer, and maybe even a part 2 of this video where you go further would be amazing!
Responded in another comment but I basically don’t know how long a video will be till it’s done. Always looking to experiment with different video lengths though
@@nathanbaggs Yes I would have liked to see a deeper dive
@@nathanbaggs I'd vote for longer/more detail, or alternatively devote several episodes to a *much* deeper dive into a single game: off the top of my head, now you know how the AI gets its broader instructions what happens if you fiddle with them, how does it decide how to *implement* the instructions (what does it prioritise, how does it cope with resource shortages, etc.), what makes it decide when to go on the offensive, why did Geoff decide to go on an expedition, what strategy does it use to expand territory and explore the map, how does it select its targets in combat, is there a way of exploiting the AI, etc. Obviously a massive undertaking as it requires reverse engineering almost the entire game, but it would be fascinating to watch the process.
@@elbiggus Yeah like 30 mins.
You figured out how the file works, now you need to test your hypothesis by building new ai files with strange or fun behavior.
Yep, what this guy said. :)
I worked at Microsoft when AoE was being developed. My team would play the daily build at lunch time with 8 player games. We had access to the source code and build files. One of the employees created a custom version for us, making some improvements like unlimited population size. Once in a while we would crash the game since it was still in beta and we were pushing it in ways it wasn't designed. We had access to the daily builds of all software so we could try all the games being developed. We all got into Monster Truck Madness for a short time. I reported about 20 bugs that I found and got a thank you email when it released. We were playing truck soccer, and suddenly we each had our own version of the ball that the other couldn't see. A head on collision at the peak of a hill sent my truck into the sky only to get stuck there. Another time I reached the border of the map, and got stuck there too.
What a wonderful story, thanks for sharing (: I bet you have some interesting war stories from MS back in the day
The AI in AOE1 is controlled by 3 files. The AI file lists the build order, PER their general behavior towards what they've built and towards other players, the PLY file defines how the AI attacks other players. The AOE Heaven website have guides for each file, but they're not all-encompassing since the AI wasn't publicly documented, it's sourced from modders and what they could find.
Cool thanks for the insight. I try not to look too much up before I start as (for me) it ruins a lot of the fun in figuring it out
@@nathanbaggsreal!!! but it also hurts when you re something and find out someone did the same thing 6 years ago lol
@@king_james_official The story of life is people repeat a lot of what other's have already done, but the exciting part is giving it a try on one's own. ❤
try the community made open ai for aoe
While already discovered before, documenting the research process as if it had not been done before is still very educational and I'd love to see more!
I really appreciated this video Nathan. When I was about 10 years old and first getting into computers and I had access to this game. Curiosity drove me to try and unpick installation files in notepad but obviously didn't get anywhere. 20 years later I'm an IT professional and write software and for a living. The desire to learn how things work has not gone away. You've made the process of reverse engineering software as accessible as I think it can be, which is an real achievement, well done!
This popped up in my feed and I audibly gasped. Eagerly and excitingly watching now. Keep this great content coming!
Hope you enjoy!
@@nathanbaggs I most certainly did. I'm needing to brush up on using Ghidra so why not also enjoy a video at the same time. Thanks!
Love it when people try to reverse engineer stuff in old games. There's a guy that spent years working on a 23-year-old WWII 2D real-time tactics game of which the source code was lost to time, and he managed to get modern screen resolutions working which nobody in the last two decades managed to do successfully (the game was hard coded with a crappy resolution with square aspect ratio). The difference it made was absolutely huge and it works flawlessly.
Do you happen to remember the name?
@@ErtugrulK Sudden Strike (1999-2001) and its expansion pack "Forever". The author has videos on it on TH-cam, HD mod it was called I think. Was a popular game back in the year 2000 in Europe, tons of mods and thousands of custom maps, but until 2022 nobody had ever managed to get higher resolutions working. Even the company which bought the rights to the IP years ago said they were unable to find the source code for the original games.
You mean drive.google.com/drive/folders/10PJJZEpNKPTI3qaGkq2riW-FhRaIDK4i made by Vladishav Ivanishin, and shared by Wilhelm Kop?
I came for the Wololo, stayed for the dissection of one of the games I played as a child.
Wololo
Roggan?
One interesting AI quirk is in the original Dungeon Keeper. There's a map where you're pitted against an AI keeper, rather than heroes. If you spend too long building your dungeon, the AI keeper essentially just runs their own dungeon into the ground and all their monsters leave. You spend you're time building and training the perfect army to take them down, and when you're finally ready to go steamroll in and take them on all you find is a husk of a dungeon with a load of empty rooms and maybe two or three flies.
Wow I remember that, I always took a long time to train most things to level 10.
The AI in Dungeon Keeper 1 and 2 is awful. Deeper Dungeons claims to have enhanced the AI but I gave up on the 2nd level.
Really interesting reverse engineering! Especially the reveal of “this can’t happen before that”.
It’s been 25 years since I did this kind of things and I’ve forgotten a lot of my tricks, so it’s really nice to follow along.
Yeeesss! This is the type of content I love from you Nathan. Take a game, and do a walkthrough analysis of exploiting it. Amazing, hope you can do more, and in way more detail!
Oh man the music throughout the video takes me back..
Really enjoyed this!
Thanks! It was a real blast from the past for me as well
I've been learning the basics of C lately. I can't tell you how satisfying it is to finally be able to (somewhat) follow along with what you're doing!
My dad still plays this game, he's over 60 and usually he just falls asleep while playing. 😂
Incredible video, as always. Keep it up!
Thanks, will do!
This is way above the level of programming I know how to do but it's very interesting to watch someone try to figure it out. I've played a lot of RTS games and used editors for those that had them and one of the things that really stood out for me about AOE was the fact that they had all of these descriptive names for the different AI scripts that specified civ and bulid order in the file name. I was confused when I started working with other games and was only some kind of "default" AI. Makes me wish more games would include some kind of more detailed AI script editor with their map editor.
This is great content. The format of walking through your thinking process and working through reverse engineering something is a great way to teach and get people excited about this subject. Thank you, keep it up!
longer videos please!
I am experimenting with video lengths. To give an insight into this particular video (and the challenges around it), I spent about two weeks doing all the reverse engineering at which point I looked at my notes and could see the story I wanted to tell. It felt like a lot of content but I don’t really know the video length till I spend another two weeks scripting, filming and editing. Basically I don’t know how long a video will be till it’s done
@@nathanbaggs This would have been better if it was about 50% longer (assuming you found the content), but every viewer is different. I know this felt a little short for me.
Will certainly be playing around with different video lengths in future videos. Like I said I looked at my pages of notes and thought I had loads of content, but it all edited down to this
@@nathanbaggsLonger videos also pay significantly more🤑
This was a great watch, hope you can do more AOE debugging in the near future.
It was great fun to do - I think I will probably look at something different next, but return to AoE in the future
This has the same vibe as watching National geographic on those investigation and historical shows.
Had fun watching this video and hope you do a series of this. The end results does not matter, it was the vibe and the journey that was entertaining
Thanks! That's kind of what I'm going for, just solving interesting problems using games people love
2:31 I listened to this bit 7 times to eventually get that it was "ProcMon" and not "ProcMutton". Also yay for Zerg rush; my uncle used to play AoE2 and was pretty good against the CPU but got trashed in online play. I was watching him do an online match once and he explained how everything would seem fine for about 5 minutes, then it would happen. Sure enough, a few minutes later his base was swarmed by an endless stream of cavalry units, followed rapidly by a loss.
[edit]
BTW I really enjoyed this. I might suggest one tip if you haven't tried it already: to make life more enjoyable when doing the "window dance", or for setting up a new game exactly the same way many times, it's worth automating with tools like AutoHotkey or AutoItScript.
12 minutes that was almost sure no less than 12 hours. No matter what, you have all my respect. That’s no easy feat.
Yeah about two weeks of RE work (and another two to script, film and edit)
This is the coolest thing I have ever seen! Immediately subscribed I need to learn how to do reverse engineering
Welcome!
Love the Star Trek reference! "I cannot do it cap'n"
I don't have the power!!!
mate, you're my hero. I loved doing this sort of thing as a kid but never mastered it like you. I want to get back into it. Thanks for this!
This level of debugging!! It's amazing to watch. Thank you
It’s fun seeing your channel grow! Keep at it :)
You have also got to think about things like player interaction. Like if you went over and destroyed their barracks, they would need to replace it to continue making troops. That 4th column definitely looks like it's where the action needs to be done. -1 just seems to be like universal, placing buildings etc which you wouldn't need to click on something to do. Whereas Man is 109, which looks to be the TC, and archer is 87 which looks to be the range.. Pretty cool tbf! Would be very easy to tailor the instruction set to difficulty by just making the build order absolutely perfect or making it terrible haha.
I would love to see a in depth analysis on the grid path finding system it uses
Ahhh a reference to the sausage variable from the horror game with spaghetti code written in Finnish 0:03 😂
are u familiar or heard of userpatch, capture age, openage, freeage, aegis aoe engine?
7:14 the AI got confused because it couldn't find any berry bushes or animals to hunt(except Elephants but it avoids those in the very early game).
I only reverse engineered the cracked version not being properly cracked back in the day. Fun-fact was that the RZR version was like 30 megs and contained the full game, while the full with CD was much bigger (also when installed I think) so I preferred that. However they only seem to have cracked for single player and multi did not work so I did it with softice, HIEW and some other similar tools. How great days they were - good to see people still do these kind of stuff 🙂
Thanks for the story - it's great to know I'm just a small part of large community that loves playing (and breaking) these games
@@nathanbaggs I did reverse GT97 Racing though - because all version online are buggy and the time for checkpoints go too fast - but its a smaller game and dos game - likely my latests achievement in similar vein but smaller than looking around the AI of a game...
Interesting finding there was that one can actually use dosbox as a debugger for smaller games and it eases a lot 🙂
I know there are people who reverse still - but always nice to see. There was this russian guy who created awful lot of DLLs for making games run over opengl instead of DX and often helped them work better on linux for example.... many great people - just never saw ai reversing before ;-)
This just became my favorite channel
Thanks!
It is easier to debug a game or app that uses DirectDraw to run in fullscreen mode on a 2-monitor setup. You use one monitor to run the game and the other one to debug. Alternatively, if you have 2 computers, you can use the remote debug feature (run the game on one computer, and debug on the other one).
Would be amazing an analysis of Worms 2/Armageddon AI
You make it look easy. I tried to reverse engineer a 1mb command line program using Ghidra and it was too hard (1 yr later the company open sourced it anyway).
I cut out a lot of the misery and me banging my head against the wall
@@nathanbaggs as a programmer very unfamiliar with reverse engineering, it would be cool to have a "behind the scenes" as a separate video to see how you tackle problems (all of the ways in which you've been banging your head against the wall lol)
Thank you for these videos! ❤
I finally came across this gem of a video!!! Thanks in advance bro, I subscribed immediately!!!!
I love your videos, they're very informative
2:55 ty internet dad this is funawesome
I wonder if the same type of practice / application could be used to disassemble car ECU Code?
I've heard LLMs are good at deobfuscation code, what is your take on it?
I find that technique where you decompile the whole exe and then search for a particular offset in order to find where a member variable is used really interesting. A couple problems I found with that is that first, sometimes the decompiled code uses for the same member a different type cast, so 0x160 cast as an int becomes 0x580 cast as a byte (4 times that value). Second, how do you deal with low offsets, which are super common (e.g. 0x08)? I'd be awesome if you go more in depth with this topic in your livestreams. Thanks for the awesome vid!
It’s not a perfect technique, but can be useful as a way to quickly search for offsets
A comparison of sorts between Age of Empires and Age of Empires 2 in this style would be awesome too
I would literally pay to learn those skills
Is it still possible to create a map hack on age of empires 3 definitive edition still today? Even tho the game got a lot of patches?, and are you planning to get into age of empires 3 after you're done with aoe 1? Thank you for those videos, im just getting started
If you would like a challenge you could attempt to get the players colours from game memory in Company of Heroes 1. I've been trying to do this for a while and its hard because the colours appear to be assigned by slot order when start positions are fixed but some kind of random algorithm when the player positions are set to random.
the person who wrote userpatch for aoe must have done a fair bit of reverse engineering, because he managed to enable modern resolutions, increased population, update and improve ai capabilities, and fix many bugs in the map editor. interesting to see the tools used. can they generate c as well as asembler?.
mostly cheat engine to get pointers. ik well the creator of up
would be great if you could find a way to make the game "TechnoMage" completely fullscreen, because it runs on modern computers only with a visible title bar on the top. That german game is very underrated and beautiful.
I’m so glad (and a bit teary eyed) to see the O.G. AoE…started with this in 2000 maybe and then found AoE Rise of Rome Expansion Pack. Brings a lot of memories. I still play it with my brother on Steam. And no offence but I’ll never be a fan of another AoE variant. And btw, great work on the back tracking
Very entertaining. Do you think you could do an analysis of this sort for Pharaoh: Cleopatra? The games are similar, but Pharaoh is really quirky in a lot of ways.
Great video @nathanbaggs!
Id love to see your thought process while reverse engineering
I try and capture as much as I can in the video, but a lot of the time it's just me looking confused
I stumbled on your channel by accident. How the hell did youtube know I wanted this?
turns out I most needed to hear the AoE menu music today then learn something cool!
When you want to patch out an instruction, what is the next step to run the patches version of the game? Does it need to be recompiled or…
That’s a good point, sorry I glossed over it. Ghidra has an “export program” option that allows you to save a new copy of the binary with the modifications
@@nathanbaggs ahhh awesome, thanks for clarifying. In your defense, you’re the only one who answered this question which I’ve posted on several rev eng vids
Thanks for explaining so well.
I'd be hyped to see more reverse engineering of this game. The pathfinding in particular always seemed a bit broken.
There's certainly more I can go into in the future
I've watched a couple of your videos in total awe, although i ha no idea what you are talking about or what you are doing. Your knowledge impresses the shit out of me. I'm so jealous.
Now imagine what the guys behind Diablo 1 HD had to do with their reverse engineering, this is a very intresting insight.
which university course do i take to get skills like this?
Not sure I can advise on this. I did computer science masters but picked all this stuff up after uni
@@nathanbaggs thanks for replying
Hey Nathan, I would like to suggest another game to reverse engineer, and build a resolution patch for, Peggle. LOVE playing the game, HATE the resolution it runs at in windowed mode.
It would also serve as a great tutorial for me to apply this info to develop personal patches to further games, such as the other versions of peggle, or sonic and sega all stars racing (While the resolution is nostalgaic (seriously IDFK how it invokes nostalgia for me lol), I want to use the full 1080p resolution of my monitor)
This was great and all, although very short
I've been a programmer for over 30 years and I'm still not even near the debug-magician Nathan Baggs seem to be. I feel like it would really up my game, but there's so many new things to learn too. =)
Always be learning
I've been playing the original AOE since its release in 1997 (last time I played was 2-3 days ago) and I never knew there are AI files in the game haha. I never checked. Interesting.
What a banger of a video, enjoyed the way you've dissected the code. It was straightforward to follow, well done :)
Just gonna request if you could do the same for BF1942 because why not?
The Spiffing Brit has shown that people do watch long-form videos. Something like this needs a good chunk of time devoted to it.
This is a fair comment (and one others have also said). The issue I face is that there's no clear correlation between time spent doing reverse engineering and length of video. This was about two weeks of RE effort, which I thought was enough to tell a story. But by the time I scripted, filmed and edited this was the length of video that fell out. Just a behind the scenes insight - I'm always experimenting with content length and type
@@nathanbaggs Yeah, that's fair enough. I guess you have just hit the right formula to get our interest and we're demanding more because it's easy for a viewer to assume you should be making content every waking hour!
Almost all screens were 4:3 back then. There were barely any customer models other than 4:3 hence why you only need one value for the resolution.
The 800x600 automatically was chosen when you chose 800.
Is this some very minor optimization?
Saw the title about shit my pants lol
I’m pleased it had such an impact
@@nathanbaggs oh absolutely good sir
I want these skillz!!!
Need to watch more videos!
Wowwwm awesome, another video with more game logic would be nice! Thanks
Please make more of exactly this :D
That’s my plan!
@@nathanbaggs aoe3?
Wololo.
Great vid once again!
Wololo
Are you open for jobs? How we can contact you ?
This is what the people at GOG do, a lot of respect :)
So GOG is patching the old games to run on new hardware? I thought they only provide the platform.
@@vast634 That's what they do, there's a video of GOG where they explain all the things they do, it was very interesting watching that. I guess you can find it on youtube.
@@andlinux Ok, will look for it
can you check if the remake uses the same system? maybe you can't debug it because of the drm (unless you get it from a questionable source)
I see "Age of empires" in the title. I upvote immediately!
Wololo
@@nathanbaggs rogan?
Excellent work!
very happy I found your channel. Would love a collab one day
I would love for you to check out the code for Full Spectrum Warrior, Idk just for fun, I like these videos so much for some reason. Oh and Ghost Recon as it's main menu resolution is "hard coded" which is so low it makes it unplayable on some monitors.
would be interesting to see if sonnet/gpt can do this function guiessing to speed up overall process
Nice format. In a short video a lot information.
I love this RE series
how to reverse engineer 'age of empires: just throw it in the recycle bin.. job done! XD
That was so fun, I want more
I hate that thing with debugging a fullscreen application in the same computer because of focus.
I always use remote debugging for this reason, usually I run the debugee in a virtual machine.
I don't think x64dbg has remove debugging (maybe as a plugin?)
Does chatGPT can help reverse engineering? If you paste the assembly
Haha no
@@rosen8757 he would need to create a topic and feed it lots of data, then ai will know what to do
@@AEGISAOE but the "ai" would always decompile some instructions incorrectly so the decompiled code would not compile down to the same machine code. Thus making it useless.
And what is the need for it when the available tools already do it correctly?
Great tip about dumping the sources, thanks. Also it seems that you cut it way too short, I could watch many more of these videos.
It would be awesome if someone could show how to do this sort of thing (windows exe reversing) alongside wine on linux 😉(though I really should probably just look it up myself at some point). As a bonus you wouldn't have to patch the app to stop it from forcing focus or a resolution globally for all other apps.
u use wine too?
Since this game just uses normal window with WS_POPUP how much effort would it be to create open-source windowed mod? I know that there is high resolution mod out there but I don't like the idea that I have to download closed source thing from some random forums. Would be cool if there was open-source dll that you just inject into game and it made game window be freely resizable with optional alt + enter fullscreen. Of course I don't want to wast your time so if it would take weeks to make don't bother yourself with actual implementation just because this random youtube comment.
I've always wondered why Microsoft chose to name mangle basic functions by adding an underscore. I suspect it had something to do with not wanting name conflicts with kernel functions, most of which don't use an underscore, but I guess I'd have to ask someone from Microsoft that question. However, it is odd to me that Ghidra wouldn't automatically correct that name mangling.
Hi, wondrous job. Just i think you partially reinvent the wheel. Check out "How the AoE2 AI Thinks (ft. Promi)" by Spirit of the Law. It breaks down AI concepts of AoE2, sure it will be different but some parts might be similar enough so you will not start from 0.
are u ai scripter as well?
Can you do Warzone Tower Defense? It was one of the first classic tower defense games but it is .swf file when Flash Player was alive
Nice one, indeed RE takes a lot of time ey. AOE1 was also one of the first games I hacked/modded as a kid
Mr. Froddo Baggens of RE, why not you use your Ring on Starship Troopers, the 1st old RTS one, you command like 10 soldier with different abilities, in 3rd person; the thing is, the game will just bail, sometimes not even a error message; there's a specific mission I remember that will trigger this probably: is a mission where the Engineer, in a 'Mech Suit has the unique opportunity of all the missions, to deploy as many land-mines as you can set, you'd be alone, so be careful, and when deploying like 500 of them, the game crashes, other missions also have unknown limitations like that. Also DID F-22 ADF when you go at the right edge of the map, it'll exit without error, you don't actually get to the edge, but very close to trigger the exit. If you could fix these and increase the capacity of the buffers, or whatever gets overrun, and teach ud how to fix it, would be great and have our eternal gratitude
i agree, we need this guy
I once tried to extract the sprites of this game for fun, all these sprites are store in SLP files, these binary files are not compressed, it's not difficult to read and extract the data if you know the structure.
Sounds like a future video...
@@nathanbaggs yes, I can help you some documents.
we modded that game over 100 times, we even made it a 3d shooter
You remember Tormentium? He knew everything about this game. He tore it apart and built an online hack for it back in the 90's. Spoiler Alert!!! I beat him 1v1 while he was using hacks once. Up a hill in ArcherWar. If you know you know. Among Koren 9 year olds, my stiff old man hands are legendary. There's nobody on this planet who's played AoE online competitively that I haven't beaten in a 1v1. I was always too SLoW for em.
The way the script works is there's a base behavior for the starting villagers. They always build houses, a storage pit, and then prioritize between fishing, berries, or hunting, based based on the map seed. The script changes based on local resources and map placement. THEN it goes to the Civ specific AI. The map seed determines most of the behavior prior to the development of civ specific buildings and units. Little shortcut from back when there were no clear paths to begin with.
I sacrificed the print on many a keyboard and put a few thousand miles on some mice to this game. Good stuff.
ozone
@@AEGISAOE I smell newb.
Can you please take a look at the unit pathing in Age of Empires 2 DE, and identify the pathing algorithm? It has been a hot topic in the game community for at least a year