AI Learns To Play Lethal Company
ฝัง
- เผยแพร่เมื่อ 10 พ.ค. 2024
- I taught an AI to do the ship command role in Lethal Company. The AI mans the terminal to view the map, and communicate all the information to me. It can also counter outdoor enemies like dogs and giants. At the end, me and the AI play a full game to see how many quotas we can get.
Watch the final run here: • I Played Lethal Compan...
Source Code: github.com/Synt-Axe/lethal-co...
My Discord: / discord
Chapters:
00:00 Lethal Company AI
00:18 An Old Friend
00:49 Roberto is Born
01:05 The Map
02:41 An Upgrade
03:20 More Numbers
04:54 Hot & Cold
09:03 The Grid
10:54 Outdoor Enemies
11:21 The Giant
11:47 The Dogs
12:05 Commands System
12:47 The Final Run
Similar Videos:
Markiplier - WE LOVE THE COMPANY | Lethal Company - Part 1
• WE LOVE THE COMPANY | ...
Bread - What does v50 hold for us? Lethal Company
• What does v50 hold for...
b2studios - AI Invents New Bowling Techniques
• AI Invents New Bowling...
AI Warehouse - AI Learns to Walk (deep reinforcement learning)
• AI Learns to Walk (dee...
Sebastian Lague - Coding Adventure: Making a Better Chess Bot
• Coding Adventure: Maki...
AI Tango - AI Learns to DESTROY old CPUs | Mario Kart Wii
• AI Learns to DESTROY o...
Code Bullet - AI Learns to play JUMP KING
• AI Learns to play JUMP...
Primer - Simulating the Evolution of Aggression
• Simulating the Evoluti...
OpenAI - Multi-Agent Hide and Seek
• Multi-Agent Hide and Seek - เกม
'You're about to die.' in such a robotic tone had me in stitches
Fr scared me for a second as well.
Just needs to replace the voice with the quote from the Red Queen and it'll be perfect.
I wish that was kept in the final product in some way. Maybe transmitting “UR DEAD” in the signal transmitter thing when it detects a lot of enemies around you
F word
reminds me of GLaDOS
11:33 I did NOT expect there to be a dog watching the giant too 😭
"You seeing this shit?"
dog was chill like that
@@LilBuddyArmy *Yep*
10:34 Roberto was haunted by the ghost girl and when he died to the dog, the ghost girl went on to haunt you instead
Haven't thought of it like that. That makes a lot of sense.
You can get haunted without entering the building?
@@spynix0718 Yeah, she picks her targets by specific conditions even outside the building.
I thought it was based on paranoia? Or is that only a small factor?
@@crem444Smol.
4:22 "The numbers Mason ? What do they means ! Mason "
call of duty black ops be like
almost sounds bingo related
I just got flashbacks
5:03 that bracken snap fucking killed me 😂💀
the one at 4:07 is straight up overwatch from half life 2
automatically the best variant
Overwatch reports hostiles inbound. Keep sightlines open and sound on
@@ERROR-yl3un
affirmative, scalpel-3 on standby, scalpel-4 reports possible biotics on site 3B,
directions?
Make this the new mimic AI
Oh god.
No. NO😭
this will be more fun
I feel like the 1st method of loot finding has a lot of potential, you just have to present the information in a more human friendly form. Maybe using compass-like directions(front, right, left, back) and a scale from cold to hot to measure distance? That way you could process the information much easier. Numbering the items might also help(something like "items two, first left warm, second front cold").
Incredible idea, loved the video!
i don't think this is real
I have similar idea in mind. Instead of using only numbers, AI could interpret the information in more understandable format like "Nearest item: 10 oclock" and when combined with hot-cold system, it would be very helpful. Additionaly player could use voice commands through radio. For example if player asks where nearest item is, AI would answer "Nearest item: 10 oclock, nearby". Last thing that could be added is whenever AI detects something, it would give a player an update "Enemy on radar, 6 Oclock", "Item on radar, 4 Oclock".
LOOT, 6 O'CLOCK, COLD. TARGET, 3 O'CLOCK, COLD. TARGET, 4 O'CLOCK, HOT.
@@fandovec03 You could also request radar booster flash/scan, or dropship with specific item/cheapest item (distract) i.e. [AI NAME], FLASH ALL. You could have the AI request confirmation for any recognition mishaps or use text commands like [AI NAME]_FLASH_ALL.
Despite how cold the name Roberto is, you can't deny how hot his voice is!
What
@@NubE-Coyou heard the man
his name is hot too. i want to date roberto
Why are there so many weirdos todays bruh.
I would change the grid to a 3x3. It'll fit in one message, which will make it a tad bit easier to understand, even if it is slightly less precise
Agreed
4:22 you've fucking made an AWACS
what's that?
@@hypeman958big radar plane that tells their side where other stuff is
@@hypeman958 Airbone Warning and Control Systems. Big radar slapped to a plane (these aircraft are the ones with the big circle on top of them) that acts as a mobile radar for their forces.
@@hypeman958A plane with a big radar that’s notorious for just throwing numbers at pilots and expecting them to know what it means. An average AWACS callout has I think 4 separate numbers, and that’s per aircraft or group
For the Company
11:32 Hahaha I love this part
If you guys could share the video, it's really well made and would probably be so interesting and cool to many people
Itd be cool if you also checked the type of enemy.
You can do this because:
1.) The size of the dot changes depending on how big/small the enemy is
2.) How the dot moves.
Examples: (keep in mind I havent played for a bit so the sizes may be off)
- medium dot that stands still could be a headcrab.
- small dot standing still around loot could be a lootbug
- medium dot running towards the player, but when looked at moves away could be a bracken
Some other suggestions:
- switching from minimap mode to hot/cold
- communicating if an enemy is approaching.
- telling it to toggle doors/turrets
- communicating about outside threats when you are looting in the facility
Your channel is gonna blow up soon man. The comedic timing and jokes in this video are so well done, the storytelling is great, especially how you gave some insight into why you decided to do this in the first place.
Keep up the good work man
Thanks bro, I appreciate you.
woah this is neat. it would be cool if you added turning off mines and turrets and opening doors, too! surprised to see only 233 subs, so have another.
[Him]: You Seeing This Shit?
[Dog]: Yep-
11:35
Just found your channel, and I'm super excited to see it grow!!!
I would love if this was on thunderstore
The first system with clock directions, but not stating distance could work pretty well. Sort the distances from nearest to farthest, and say just the clock directions, so you know what's nearest and which way it is.
Superb idea and a perfect execution edit-wise. Applause
This was so cool to watch! I love the uniqueness of this haha
This is insane!!! This guy needs more attention,
such a great video, liking for the alogorithm
Will this be released as a mod on thunderstore, or something along those lines? Either way this is REALLY cool!
The code is public now, so you can run it yourself. But it's not a mod. You'll have to run the code on a separate instance of the game if you want to play with it.
I would also love to see a mod with a similar idea in the future.
Instead of using a dropship to counter the dogs, you can actually ping the radar booster.
This doesn't use any money.
For example:
ping Bob
However, you do need to ping it continuously to keep the dogs there.
The “hot and cold” system sounds like it would be a item in game.
your creativity blows me away!
I was almost expecting for your AI to say “keep summer safe”
PLEASE RELEASE THIS AS A MOD!! it would be great for people who have no friends
0:41 hahahahaha
Subbed, loved the video, keep it up
Great video, can't wait to see this take off
11:32 blud got a buddy lol
Note that my comment below is incredibly presumptuous and hard to create IRL, and is more a fantasy than anything!
I feel like the hot and cold system is better, and what you could have done is still do 5 second intervals, but the 5 seconds for enemies and 5 seconds for loot is spaced apart by 2.5 seconds. Personally, I’d make them both 6 seconds with a 3 second difference
A new enemy enemy system that I believe is more ideal would be kinda similar to how the first detection method was described, though more efficient and easily understandable. If an enemy is getting closer, it says “enemy closer”. If an enemy is getting farther away, it says “enemy farther”.
Now let’s add some chat capabilities on top of its power of speech. If a triangle is moving around, then the AI will finally use chat to tell you that there is “lootbug or nutcracker, closer/farther” and direct you with hot or cold in the chat. If there is an enemy that is stalking directly behind you and never loses sight of you, then the AI will tell you in chat “Bracken”. If you are outside, the AI will check for massive red dots and tell you “Worm” in the chat.
Also, if there is no loot or no enemies, the AI doesn’t say anything or at least the option to not say anything when there is nothing should be toggle controlled.
Now we can talk about various other jobs the “ship mom” role has that the AI needs to fill. Teleporting is a big one. The AI will just detect if you are rapidly spinning and if you’ve spun like this more than 3-4 times in a row, and then it will use the tp command on the terminal (overriding the flash command for a brief moment). If the AI sees the player approach a closed blast door and stand by it for a moment, it will open it. If the player is idle for more than 30 seconds with an enemy nearby (aka staring at a coilhead), it will automatically teleport you. If your player indicator on the terminal becomes a darker shade of blue (aka death), it will automatically teleport you. If you are nabbed by a forest giant, it will immediately begin teleporting you.
Great idea
(I didn’t read a single word of what you just said)
@@Aimyx Hmm then maybe don’t comment?
@@guts60 you got guts man
I can definitely see how the enemy recognition would work. Recognizing human player action and providing evac seems harder, but by the standards put out by this video, (hopefully) not impossible.
Honestly i love the number system, it had a high skill ceiling and the chance to not understand everything with the robotic voice just adds to the atmosphere.
I genuinely feel like it could be a kind of ship upgrade a player on the ship could manually activate.
يسطا الاكسنت بتاعك جاحد ❤🔥
حبيبي, جزاك الله خير.
@@synt_axe bro liked the content keep it upp
I would've increased the sample rate to as high as possible and made the AI play a beeping sound that gets faster based on distance like a metal detector for a item, and play a hum sound when staring at the item that gets quiter the further from the center of the cone to being quite if its greater than 45°
I then would've made the AI verbally communicate the enemies, and verbal shout "Danger!" If someone starts moving really fast and "Caution" if a enemy is close to you.
I just join random lobbies and either leave when they suck, leave when they spam music or skits through their mic, and stay for hours making friends and getting hilarious moments. I love the Company.
Great video!
this is amazing
Couldn't you use the grid system to make the AI say something like "items straight ahead" rather than the confusing numbers? Like
"Item up, enemy 3 item right, enemy down, 2 item left
There are three enemies around you....
Your about to die.
The grid technique is so cool
you are a mad genius
Makes me wonder if we can get (somewhat) authentic singleplayer bots at some point that run on similar navigation code to the monsters
Not really an AI, more like an algoritm, but still pretty cool^^
Something that might be of use is depending on the size of the red dots you can see what enemy’s there are!
Imagine the grid but say it puts a letter for what each enemy is.
For example 5 hoarding bugs is just 5h
A coil head and a nut cracker are cn
Stuff like that
11:31 mate looks like he's about to cast some spells
4:08 THE NUMBERS, MASON, WHAT DO THEY MEAN ??
Part of me is like: "Can you install this to play with yourself, and how"?
The other part is: "Chaos with friends"!
You should publish this on thunderstore as a mod
you should make it so that it can tell you if your near the exit when shown
This is really cool!
“Stop talking about me” kills
Fun Idea: You should use the sounds of the motion tracker from Aliens to detect the distance of enemies or loot.
amazing bro
How does this not have 100k views?? Very good editing and cool concept
Agree!
I find it missleading - there is no ai involved, just image recognision
Image recognition is technically a type of generative ai so it is artificial intelligence.
Now there is a 150k views
cold, hot, cold... very cold
Underrated
Don’t know how feasible it is, but would love to see this as a mod that people can download, would make solo play or small group play more fun without outright cheating via minimap mods
the idea of just hearing "hot, cold, 1 enemy" is so terrifying, like knowing something is there and not knowing where is horrifying.
Underrated!
I love the hot and cold straight into the Bracken
"Cold...Hot...Cold" *SNAP*
Worlds most creative video. Does this use a neural network? How did you calculate the gradients for backpropagation? (If you used it)
Thank you!
It does not use a neural network. The script is completely reliant on Image Processing to get the data it needs from the map.
I published the source code, you can find the link in the video description.
11:33 HAD ME DIEING
Same, I ran straight to the comments
Tbh I'd prefer the numbers. seem pretty straightforward and you gets loads of information quickly
I always felt like Leathal would be even more fun if their computers to help assist you during solo gameplay.
Hmm... Your filter already recorded which way you were looking. What if it only reported in the direction you were facing after clicking your walkie talkie? With alerts when enemies get close?
It can detect you clicking via audio cues!
Take my sub and keep making great content like this please
interesting project, the clock one seemed like a good place to start, but I think the issue with the clock was more the voice and format, breaking the numbers up with an o'clock and also speeding up the voice and using a more natural one should make it a lot easier to understand, I feel like due to the limited vocabulary, using an Ai voice or text to speech voice is unnecessary, you could just record your own voice or use a better voice synthesis Ai. Then have it report the loot and enemies based on how far they are to the player. Another way to make it better to understand would be to replace the distance numbers with close/far categories.
The hot cold seemed interesting and intuitive, but I agree there was not enough info but wondering why you didn't add more categories for distance, like having cold, cool, warm, hot.
Another thought I have is instead of having the Ai periodically broadcast have only broadcast when you message it, if it gets a transmission of any sound it replies with the info. Something more advanced could be training it to recognize a couple commands, or using a speech to text, then you could send a message enemies and it will tell you if there are any enemies and where, and items and it will do the same with items. Another idea is that it can message when enemies within a certain range. You could probably even have it tell you what enemy it is based on the size and speed and maybe behavior.
Me with no friends: "Finally... I can play this game"
What if the system was just a monotone beeping increasing in tempo whenever something was close
11:34 well i didn't expect that
what if he confuses a mimic for you?
The numbers honestly sounded like she was Overwatch from Half Life 2 giving codes to Combine officers.
You forgot to make it so that he can tp you in emergencys
11:51
You could also use the ping command
Talking to the dog kinda scared me cuz it was right there but he just looked over like a pet lol
this is hilarious and you should definitely explore more with using ai lmao
This is pretty cool!
will this be a thunderstore mod? if so. best idea yet
You should add a function where roberto activates the ships teleporter on you so you can easily get back to the ship just incase you need that
this is insane
how about making it possible to change roberto's suit as well
chingon, introverts will love this lol
Did you know you could use a walkie while still on the terminal? Super useful if you use the voice again
i want this mop for playing alone
''Tell me you have no friends to play Lethal Company, without telling me'' moment xD
I wish Roberto still had the voice, that would be more hilarious lol
what module did you use to analyze images?
I feel honored that the ai has my name
11:34
"⚡😲📳 "
"You seeing this shit?🧍"
"Yep 😎 🦯 👂"
This is so far one of the greatest Lethal Company videos I've ever watched, the AI is so 🔥
with the hot and cold why not add a middle on Warm and warmer?
Yo I’ma do the numbers strat when I’m on monitor from now on
that was funny "I said stop talking about me"
Wow amazing
Would this work well with more players? Also, I have a hard time reading and was just wondering if you could make a video guide on how to set it up?
Hope this helps: th-cam.com/video/hxgGS1V1P40/w-d-xo.html
Is it possible to make it as a mod pack that other people can use it?
4:59 so out of pocket 😂