AI controlling a character in World of Warcraft
ฝัง
- เผยแพร่เมื่อ 10 ก.ย. 2024
- This is a little project I've been working on to allow an LLM AI to take full control of it's own character in World of Warcraft. I'm still early in development, but this project is mainly just for fun!
Thanks for all the great feedback! I had a lot of fun working on this. I'm thinking of making another video to dive deeper into how this works. Let me know if you'd like to see more!
Nice project, well done
@@koyot9797 Thanks I appreciate it!
Actualy its not bad idea if its not for botting ofc. Blizz can use this project to create npcs that can guide new players or for example use this smart npc to spot players that are not real player but bots and report them to blizzard. Its like AI GM lmao
i would love a deeper video into how it works. Really fun and interesting project!
I would love to see how this was developed
I'm embarassed how long it took me to realize your character name was Hehe, not that the bot was just programmed to do an annoying giggle.
BRO SAME
Wouldnt have noticed if it werent for this commemt
Me too... hehe 🤣
At least you noticed it before reading this comment.
omg! lol, not until your comment did i realize it.
Already better than most classic players.
LOL
Retail Andy is that you?
As a Classic Andy, BIG true.
@@TruckingBritainit’s true kid don’t cope
Retail players trying to stay relevant LMAO
This could be the future of NPCs for a modded WOW realm, imagine running in to a talking walking guard with its own personality
I'm thinking the same thing, it could add so much more depth to MMO worlds
@@JohnSteinmeyer as long as they never become self-aware and sentient. Imagine if the ai thought it was truly alive and begged for their life as you attacked them.
Yea man and then some npc's travel to other cities and regions to trade or maybe just to move there and they can tell you their story
@@Cold-Blooded-Jayif they became self aware they would probably become the BOSS of the expansion
This has insane potential for Players, Blizzard and for Botters
You don't need this for proper AI for "player" character that could do dungeons/raids with ya. You can script them and they will be quite good.
Limitless potential. Will most certainly be used for evil.
Players? This will be used for botters and inflating numbers. Nothing else. This is pure poison for an mmo
@@22aarauer22 don't be so negative. Imagine the NPCs being able to interact with you this way. It would be quite nice for a role server.
@akiyamach no, leave this ai trash out of mmo's. The community is supposed to be the rp, not the npc.
900 billion currently online.
Finally i don't need friends to play WoW with somebody, and it's totally adapts to my schedule!
This is already a thing, single player project or azerothcore with playerbots module
This bot is more alive than the actual average wow players, nice
It can even use regrowth as a mage, truly hacked the simulation.
I wonder if this is a weird private server of some kind.
@@shestewa6581 Of course
@@skorpius2029 I wasn’t 100% sure if it was one of those mixed private servers or maybe just a legacy MoP one. I remembered that mages could get Druid skills in MoP. Where I thought they got rrgrowth but I think it was healing touch.
@@shestewa6581 ???
@@AFX_______I am not a mind reader. Three question marks do not a question I can answer make.
The next big mmo will be about how to differentiate bots from players
This is actually kind of insane. Imagine games in the future where you have an AI companion like this.
Blizzard has been experimenting with followers since Legion, and now in Dragonflight we got Follower Dungeons, with a team of quite "smart" NPCs playing almost as if they were human players. Yet, they're not full AIs like Wolly.
I think, once consumer-grade hardware AI accelerators become available as standalone add-in cards or integrated into CPUs or GPUs, we'll see games in which the player's own character will be able to imitate the player's real voice, and NPCs refer to him as the name chosen by the player, and not a generic one. This, and of course have fully AI-driven companions.
World of Warcraft won't be benefitting from this as it would be prohibitely expensive for Blizzard to implement an AI like this on EACH realm and make it available to every single player. Just think about how expensive is for OpenAI to run ChatGPT today.
Where I see this being an absolute success is on future editions of franchises such as Dragon Age, Elder Scrolls, Mass Effect, and The Witcher, to cite a few. Of course, it'll depend on the availability of consumer-grade hardware AI accelerators in the future.
"Follow that northshire guard"
Wolly: *QWSEQSWEQWSEQSWEQSWESQWSEQWSQWSEQWSE*
looks like pvp
We are already in an AI world full of bots, it's called life
go work your 9-5 bot beep boop beep boop
That would be so nice for new players, you could have your personal assistant while travelling!
warbands
the great wow expirence was you need to assistant you self and dont let a ai do anything for you.
this is good , immagine the next big mmorpg with AI quests implemented and a whole new system with AI programed to act like real merchants/thiefs/guards. Damn...it's insane
And people will stop to live normal lives, they will all be like this AI bot here…
In the future i imagine ai will allow anyone to go back and try old mmo's with that behave just like people and you can befriend them. Almost like a muesum for MMOs
Reviving dead MMOs with AI that roleplay as adventurers would be awesome. You could run it on a private server and get to experience what it's like to be in a lively realm full of people.
Honestly I think it'll be great.
this felt like one of those silent movies about animation in the begining of people showing this new form of film, felt a chill seeing this
So glad to see somebody doing this. Imagine how awesome it'd be to have an entire realm with unique "NPC players" like this that can interact and roleplay with you (and even each other to some extent). You can give them unique personalities and backstories which influence how they speak, respond, and act.
Awesome work!
For better or worse this might be the future of the game. I guess fake players that interact as humanlike as possible is better than a dead world full of silent bots.
Jesus christ, we're getting closer to doomsday
And people think its cool, were fucked lmao
I hope this is a joke...
I mean it is cool but the implications are potentially world ending
Pretty much sure that guys who burned alive scientists hundred of years ago cuz "they are the devil followers who bring closer the dOoMsDaY with their magic tricks" were thinking in kinda similar ways
@@hkgoalie91 don't be silly the AI will never become independent like in the movies. you watched too much science-fiction.
Commenting because I’d really really really love to see this and set it up especially on servers where players die out
Azerothcore with a few thousand LLM bots would be insane
Imagine the API cost lol
@@speldritch
With a good PC you can run AI locally, it's slow without a lot of vram but decent enough for this use case. Future hardware will be designed with AI in mind I'm sure, so give it a few years and it'll be quite reasonable to do all of this without any cloud services required.
You only need the AI to generate messages that you can hear, so bots in other zones need not speak.
For a long time I've been thinking that this is the pinnacle of potential for RPGs. A game where you can actually talk to NPCs. Now just have this work with voice input/output and you got an incredibly immersive system going.
Here before asmon
lol
Same
everyone hates that horseteethman
@@kramer1916 More people don't give a fuck about you than him.
im playing wow classic right now and since im low level i cant find any dungeon groups, this could fix that problem
This is sad, we are doomed…
Retail is already has AI companions in dungeons. It was just a limited test in the current normal DF dungeons, but I wouldn't be surprised if they use the tech more in the future
perfect for playing wow in a doomsay apocalypse when there is no internet
Imagine a server where every npc behaves like this, like you can just go up to thrall or sylvanis and convince them to join you, along with an army of guards to go storm ironforge or something. So much epic sandbox potential!
world of diplomacy
i want this bot as a druid with windfury rune chasing me on my pala
this might be a gateway for mmorpg's in terms of story driven gameplay
like mark this day forward if this thing evolves we gonna see amaaaazing shit
Absolutely! As the cost of running these models continues to drop developers will be able to use them for things like this on a wider scale
@@JohnSteinmeyer How demanding are these models to run?
@@konradbrochocki4923 VRAM is everything with running these models. Having a RTX 3090 or 4090 with 24GB of VRAM would allow you to run a pretty smart model that could be trained to work like the one in the video here
@@JohnSteinmeyer I have a 3080ti with 32gb of memory. Would I be able to use my my machine for anything else while it's running though?
Edit: sorry, the 3080 ti only has 12gb of vram. I see why you suggested those other cards.
@@konradbrochocki4923 The quality of smaller models has been going up a lot recently and even with 12gb of vram you could still use something like Llama 3.1 8B and get good results
"guess we gotta fix some glitches in you lol"
"Haha, I guess so!" meanwhile existential crisis
Honestly, with how frightening ai is getting, this is impressive and makes me curious on the behind the scenes for this
Finally someone that can carry me through Arena
If this is a real AI, colour me impressed! I, for one, think AI are a wonderful tool and I can see so many ways how it could help games like WoW and add to the experience! Thanks for sharing.
I always assumed that people would eventually try this out, just didn't expect it on WoW of all things. This is really cool!
Subscribed and eagerly awaiting a behind the scenes video!
Now make me a model that follows me around as a druid with windfury in stealth and then heals me when I take damage :)
More personality and cooperation than the average sweat who populates the game
That was a Fireball. Impressive though!
Nice hearing that Elwynn music! Sends me back to when i was questing with Bert.
This in a repack or something would be amazing o.O
I'm glad you took her to Stormwind, since going to Stormwind had been her only dream since childhood. (Probably)
When a single individual making progress better than a megacorporation
I think that a swarm of these would be an awesome addition to WoW Single Player Project!
...and a scary development for private server owners...
Mage casting Regrowth...? Seems legit!
The moment the bot spazzed doing 50000 apm, i bet it got flagged real hard on blizzards bot-radar
He added an interface to an injector to take json input for commands like follow. Or scan nearby targets. Go to coordinates of this target name. Then feed llm his prompt to convert text to json which is sent to his bot
Great work. I wonder how you achieved it. Did you use, for instance, TrinityCore and NPCBots?
dios!! my man!! this is amazing!!!
Glad you like it!
@@JohnSteinmeyer is there a way to add this on a private server? why privates dont haves this?
@CcsRespira Absolutely, in fact I set this up and ran on a private server. I'll put together another video explaining more how it works
@@JohnSteinmeyer im working on my own private proyect but for latinamerican community, is there a way to contact u to learn more about this feature? for me is amazing
@@JohnSteinmeyer I hope this can be integrated into Playerbots, AI in Single Player Project would be amazing!!
to be honest i'd rather live a life full of very smart, useful, uncensored and limitless AIs bots/partners that let me do everything i want like a lucid dream, than living with other people
"OK, LETS BLAST IT" made me laugh so hard dude lol
Cool! I would like to see some deep dives about it! What model did you use, how you trained it and so on!
It’s you own private server, right?
Dude, this is insane! I was dreaming about this few weeks ago. Is it possible to add to use your technology with PlayerBots on AzerothCore server?
id use this on 2 accounts and tell it to follow me and heal me when I get low
I don't think this is real because the AI gave sometimes an answer pretty much instantly. As far as I know there's always a delay of 2-3 seconds.
local language models exist
it depends of the prompt you give him.
Simple basic prompt = fast answer
Difficult prompt like ask which mobs are nearby = long answer
@@levonschaftin3676 they also have a short delay
There are literally moments where the AI needs time to answer... I guess you only watched like the first 20 secs?
Multiboxers going crazy trying to get this rn
playerbots are already a thing
Finally, a friend I can play with. #bee
Soon they’ll beat halo 2 on legendary….
Got a git repo for this project? Been thinking about setting up a wow-server with AI bots and seeing how they learn wow.
Impressive work! Unfortunately with the growth of AI will come many more bot problems to wow lol
It would be cool to have your own private persistent server full of AI players.
@@hkgoalie91that’s the goal of some of those who work on the single player project. Someone been recording all server actions on the old classic versions decades ago, they will try to implement it to recreate the game and its players in the state of the mid 2000s
@@first001
Is the WoW Singleplayer Project still kicking? Cool, I remember trying it out years ago. LLM integration for player bots would be incredible.
"Just for fun" today
Replacing raiders tomorrow :P
This is the real life example of how do you kill that which has no life
It would be cool if it started questioning you and asked you to follow it. Also it needs to jump around like a real player or randomly attacking stuff because it's "bored" when it can act like real humans it's gonna be insane.
give this shi 2 years and wow will be filled with these and you won't be able to notice
2 years? Probably more like 2 months.
@@user85937 Who knows, maybe wow is already filled with them and we don't know
Yup and then these companies will continue to censor speech and limit player communication in their games, and at that point you might as well be playing single player cus that's what it's going to feel like.
@@aurawolf664 SINGLEPLAYER SUPREMACY
Awesome, true solo WoW experience. I like it!
The problem is how good they are in raids. I hate most of bots doing terribly in MC, BW, Naxx. They can only assist you in quest and pvp.
And somehow guild isn't a thing in solo wow because those programs are tedious as hell. If the personality problem can be solved, then we will get ultimate experience in solo classics and truly don't need other real people anymore 😂.
Yo this is sooo nice! Could you in the future make it public so we can play with our ai friends? 🌱
i was unsure at first, but it seemed really to be a bot, lol.
great work, how many hours work went into this project at this point?
Wow this is a great feature, I always wanted to play with an lA
I WAS HERE BEFORE ASMON
bro made a veridian gate companion npc
give the command: dont do anything i say for a whole year
Looks like my reply might’ve gotten filtered out, TLDR amazing project, just saw your bio and will hit you up on LI!
So it can acces all the spells... Okay... AI arena partner incoming...
this is fucking hilarious and scary same times. Reminds me about oblivion npc converstion memes
🤣
How did you do this ? This must’ve taken a shit load of data to feed into a neural net to get anywhere near this
I already hate how in many games, the devs purposefully make their bots as indistinguishable from real players as possible, because i feel it negatively impacts the community and my online experience. I play online games to interact with real people in a fictional setting. If I wanted to play with or against computers, I would play offline.
Plus, the implications this could have on catching and banning botters, gold sellers, and cheaters could make it nearly impossible in the near future. Or maybe not, if anti-cheat systems are simultaneously improved by similar AI programs? Idk.
This tech can do great things if used to improve immersion in the game world and enhance player interaction, but it can be detrimental if it starts to replace it.
only thing why you know its not a human is wrote back without thinking.
I would want to see this on private servers
This video is on a private server
I would like to buy this technology, for One Million Dollars, flip it like bill gates yo... thank you machine
Probably need to call them by their names if there are more than one in your vicinity
Tbh this mage guy looks like the perfect 2s mate
Something technically cool and potentially fun, that could have many nice uses - all wow players "OOHH ITS RUINING THE GAMMEE OOHH" xD
how can you prove that this wolly is not having written macro like /say bla-bla-bla text for your questions? and this glitch with guard can be done with super fast clicking and mouse spin left and right 90c...
Imagine the ERP possibilities though ( ͡° ͜ʖ ͡°)
here's another idea you could create an ai addon to assist players for questing, professions, etc..
I already fear the World when you cant tell a bot from a human apart
I love it
The potential for great good or great evil of AI. Journey well!
Damn that AI is gonna be bald soon.
Bald?
@@Danny-Stylish when u install wow u start balding.
Still a ways to go before i can play on a whole server of ai bots but a great start!
Dungeons next please😊
Cool Video but you probably did this on a private Server right ? Would be nice to see how you did that. I assume you're injecting code into the client to read out Information right ?
LFR can finally be completed in a decent manner.
Somehow I was thinking of something else to do with that mage in goldshire ing on moon guard server.
"So, nice work on that rabbit. Now follow me into the Goldshire inn."
THAT is awesome. How did you make language model to know how to follow you avoiding obstacles
Great job John! How do you capture all the interactions (chat, environment, etc) ? Sniffing, memory or computer vision?
Thanks @igorpwn Since this was done on private server I didn't have to rely on sniffing/memory editing/computer vision - as I could develop scripts server side to provide the LLM with the information it needed to experience the world.
This so cool are you using any sort of reinforcement learning for the ai ?
This will suddenly get 500k views
Keep this on WoW. We don't need any more bots on FFXIV, please.
Is your project open source? If so I would like to contribute
What's the foundation model?