StarCraft 2: Google DeepMind AlphaStar (A.I.) vs Pro Gamer!
ฝัง
- เผยแพร่เมื่อ 6 ก.ค. 2024
- Google DeepMind AlphaStar versus professional gamer in StarCraft 2.
Subscribe for more videos: lowko.tv/youtube
More StarCraft 2: • StarCraft 2: THE CHEES...
This is such a cool project that Google is working on. This self taught AI called AlphaStar from the Google DeepMind team is now advanced enough to face and beat professional StarCraft 2 gamers.
Check out Lowko merchandise: lowko.tv/merch
Support me on Patreon: / lowkotv
Join the community on discord: lowko.tv/discord
StarCraft 2 is a military science fiction real-time strategy video game developed and released by Blizzard Entertainment.
--
lowko.tv
/ lowkotv
/ lowkotv
/ lowkotv
/ lowkotv - เกม
They trained an AI to control an army of killer robots. This is fine
Well cyborgs but close enough
Google is preparing a coup against the world
"They self replicate faster than we can kill them"
totally safe. no way this could end poorly, or we make AI's the generals of real life armies. naww thats too far fetched.
I like how AI actually cares if they die, if it didn't care it'd just throw them at the enemy without regard of losing them :P this is good way to teach value of soldier's lives in a way.
He needs to learn to trash-talk his opponent too, then he will be complete.
Infuse the AI with the essence of IdrA! :D
Quake 3 Bots were masters of trash talk, was fun :)
Remembers playing Tiberian Sun: Firestorm and Cabals insults during the campaign... "Time to erase the human factor from this equation. Prepare for decimation, as you are not worth of assimilation." Golden
This is a very accurate comment. Microseconds, people.
Maybe he doesn't talk to trash, just takes it out?
After two hundred years of playing with itself we finally got it boys... proxy 2 gate.
LOL
LMFAO. the funniest thing I read all day! :D
Still better then what I managed playing with myself for 10.
It might be en example of flawed machine learning by unjust distribution of games (too many fucktards in ladder cheesing scrubs) in the sample used to teach the initial agents before they were to play against each other.
Also its really funny that in all this time of playing they didnt come up with something else. toss vs toss must be fucking uninspiring. I bet it took them some time to cross the *2gate erry game* behaviour learned in ladder out of subsequent agents.
Also the funnienst thing a machine learning algo sold as "innovative" ever did. 200 fucking years holy crap. i dont wanna know how much computing power that was.
@ETM Nation - Best ETM Music I know how computers, neural networks and AI work, so this is more of a "fun thing" to think about, but:
"It doesn't really learn, watch or understand anything by itself the way a human does." - do we tho? We have no idea what consciousnes actually is. Our best guesses goes in the general direction of "the brain being aware of its own awarenes of things". Our brain, when you think about it, is also just a .. well.. neural network. It takes sensory input and combines it with saved data (memories) to form a reaction to any given situation. Cut out the memories part and you basically got babies. What is it that babies do? Well.. not a lot. They copy their environment and learn through feedback what works and what does not. In the end human consciousnes might as well be the result of years and years of testing out stuff, forming background knowledge of what works and what does not and then using that as input for their next decisions.
Dont get me wrong, most "AI" currently is little more than statistical analysis (maybe read up a bit on the Alphas tho). The question is.. are we different? If / when we eventually develop an actual AGI (general intelligence) that is not just very good at one task: how will we evaluate whether it's actually thinking / feeling things, or just very good at mimicing what we expect it to act like in a given situation? And are we actually any different? Technically our braines are just statemachines, firing neurons based on the input they receive, as well. If we had all the involved information, we could directly calculate the next brain-state given any current state. Theoretically at least.
If we define consciousnes as a brains awarenes of its own awarenes, then AI currently would probably be at a level of "field specific awarenes (rather: knowledge)". Basically what i'm saying is that the AI learns without knowing about its knowledge, if that makes sense. Yes, sure, it's just numbers.. electric impulses, but we shouldnt really conclude that it's impossible for AI to eventually be aware of itself, as in the end we too are only a bunch of neurons, using electric impulses to form decisions based on sensory input.
"After 1000 years of games, AlphaStar has determined that nexus recall rush and cannon rush are the best strategies. Also it started trashtalking. We renamed it AlphaMermaid"
ai will create agi which creates asi then assi then asssi
Concern expressed.
Development of terran artificial intelligence improving. Adapting.
Must prepare swarm. Improve intelligence of zerg organisms.
Must succeed.
hahahhaa
If we could integrate the voice synthesis, natural language processing, and the RTS AI into one package, we'd already be near the depicted level of Terran Adjutant.
I, for one, welcome our new AI overlords!
THE GETH ARE COMING CALL COMMANDER SHEPPARD!!!
@@user-lc2sl4un4b new AI overlords don't need you
To Humans, this is an RTS. To AlphaStar, this is a turn based game.
3 turns for the AI, one for the human. he wasn't fighting against the AI's strategy he was fighting its ability to control every unit at once.
@@mys6886 Actually, it's much more limited. Because if it can control every units at once, you can't really beat it.
that was the point, cuss it does
@@mys6886 It don't do that actually. They programmed it to be able to control ONLY what is on the screen.
Because if it can do such a massive amount of multitasking, it wouldn't have lost to Mana once.
It may seems like it can do that, but it can't. Theres a different between being stupidly good, and being perfect.
It's not the computing power that makes this AI so powerful but the ability to extract information from previously seen patterns. You can make this AI much more clumsy then a human and it will still defeat most players on the ladder.
It knows the builds ... It knows when to engage and it understands the mechanics of the game.
That is what makes this AI extraordinary
When talking about the AI’s apm, you need to take into consideration the possibility that each action being performed is more valuable than a humans average action. When a human has 600 apm, most actions are probably repetitive and unnecessary, but being performed to avoid missing an action. The AI, though, is probably capable of performing each action with only one command. That would hypothetically make an AI with 200 apm the equivalent of a human with 1000 or something.
Hudson Caceres I notice pro players do a lot of weird selection and control group spamming at the beginning of the game. It boosts their apm, maybe optimizes workers a bit, but has little overall affect. Alphastar’s early apm is like mine and I’m in gold league.
600 would probably be good. That seems to be the threshold for when it starts to seem superhuman. It really seems to be over valuing stalkers because of it's ability to control them so precisely
@@BouncingTribbles it hardly over values them when you consider that it can blink them back right as the shields go down, saving the hp on the stalker, denying the kill, and letting it recharge the shield before going in again, not many other protoss units can escape a fight quite that easily.
@@majormapleleaf4944 but it does it one by one and never missclicks. Something a human can't do at a certain engagement size. The AI continues to single blink long after a human would have given up through lack of physical capability. They've already put a limiter on it, so now we're just discussing what that is
In the pregame interview, the deep-mind guy said they capped the number of apm so that it isn't too insane
Probe overproduction answer:
- reserves in case of raids, as shown in the game.
- Later transiotion to another base.
Yea I thought that was super cool, it pre-emptively over-produced 2 probes, and sure enough the raid came a minute later and killed 2 probes: raid had zero impact on production.
@@Yvaelle Later, after I wrote this comment I learnt also that 16 workers on the minerals is not the maximum. It is more of the optimal efficiency. Up to 24 on 1 field they still work, just much slower than the rest. So before workers are transitioned to another field or die in raid. They may already at least worked of their own price.
@@user-iw3fi9gx4e I used to play back in 2011, and I Knew that.. I guess I really was good back then LOL
But what is weird is that it leaves a geiser with only 2 workers for a long time while super saturating his minerals
it makes sense, considering it seems to be taking a late expansion a lot of the time
Let AlphaStar play against Has and he will probably break the whole AI with his confusing strategies :D
I really want to see this. I'd put my money on Has.
AI would probably just spell out a big '?' on the minimap.
Injecting the Has variable into the algorithm would probably set back the AI by 3 years of development.
*Could not locate Has.exe*
*Please try again later*
or florencio.
Or Florencio.
The thumbnail says man vs machine
I thought this was gonna be Innovation vs someone else
Me too
Same
Same
You merely adopted the Starcraft 2. I was born in it. Moulded by it.
I work with AI and machine learning a lot, and there are a lot of misconceptions here.
When you as a human see that the AI doesn't do something that most humans do, it doesn't "think" that this action is bad for X or Y reason, it always acts on "better" plays. You also have to put in context that it's an AI, not a human. So it's not subjected to the same caveats.
To give an extreme but simple example, a progamer could choose to always use a rush strategy against a bad player, because as a human it's hard to react well and fast when under pressure. But psychological pressure does not exist for an AI. So unless a rush is actually pressuring in terms of micro and macro even if the opponent reacts perfectly, it'll be more worth it to do something else.
Also making it play against a human actually puts it at a disadvantage, because it's never played against this type of opponent. Self learning AIs are by definition learning by playing against themselves (often different versions of themselves), or other AIs to play crazy amount of games and generate experience very fast. So even though it may appear as "oh it's a bot that's played billions of games, it cannot lose against a human player", it's actually a very hard problem for the AI to solve. It'd be much easier for it to play the perfect AI that it is itself.
Finally, these little details about sending X probes to minerals and Y probes to gas to get "perfect" amount in the early game is a typical human thought. We love to get very tiny aspects of a problem solved perfectly so that we can focus on everything else. But the AI solves the most valuable problems first to get the highest rate of winning possible, so it could definitely be possible that this aspect of sending X probes to minerals and Y probes to gas at minute Z is at the very end of the solving tree priorities for the AI. (For example, when trying to make a 2nd base the AI saw a huge improvement in winrate, so that became very important to it, while making perfect micro-macro at the beginning might not have improved its winrate by much).
Perfect resource micro at the start may have a smaller impact on AI win rate because the AI can actually defend against rushes very efficiently, but improving on the efficiency of a process will always improve the outcome unless there are opportunity costs. So I think that this is just the case of a process that hasn't fully evolved yet, and with the AI gaining more and more experience in the game, I think early resource mining will slowly improve in efficiency until it's at the peak of the possible. Unless of course the AI sees a pattern here that even the pro players don't.
There's nothing interesting about "AI". It can only "learn" through blind trial and error, and uses some probabilistic algorithms to "decide" a course of action. So yeah, AlphaStar figured that Stalker blink spam cheese move was the most successful strategy, so it just decides to do that over and over again. That's why the AlphaStar's moves seem so robotic. Unlike humans, current AI cannot think ahead, it can only learn from the past. That's what separates AI from humans. It can create cheese strategies by learning from the past, but it can't create anything new or interesting.
@@eatcarpet A lot of people lack experience, so when an AI creates some derivative of the past, they find it new or interesting.
In addition, many people find the concept of AI itself "interesting", so it's got that going for it.
thank you for the explanation!
@@godsdonttalk597 If you find an AI constantly blinking Stalkers over and over again "interesting" instead of obvious or boring, then sure. But nobody wants to see a match of mindless AIs doing the same cheese moves over and over again. People watch pro players because they constantly create new strategies that are interesting. And if an AI can create something new, then it's because they've "learned" from the pro players. But the AI itself cannot create anything new.
Your new mission: cast every AlphaStar game that you find. *All Of Them*
XD
@@DecoyJayc Well there were 11 games played, so that means another 9 to cast rn? The TLO games were the most fun to watch
@@Selenkate He means the simulated games too...
@@vald.1617 Oh... oh dear
by analyzing enough alpha star games and simulating it we might be able to improve Human Intelligence. Next step we could have different human instances playing against each other... that would be crazy!
At least AlphaStar didn't figure out how to write "gg" at the end of the match.
Imagine if it wrote "gg?" at the beginning of the map because it already predicted above 50% victory chance.
It doesn't even see this as a good game, it sees it as boring. I mean, there's all these units and strats to choose from, yet all it needs is the ridiculously op blinking nightmare that somehow made it past balancing(from its perspective if it could think like that). It would probably have a field -day- 200 years worth of cycling with intentional imbalance of Brood War.
GG HUMAN, EZ
@@thundersoul6795 this is an algorythm, it does not think. it just has a extremely high amount of permutations in the same task, but its completely uncapable in every other task.
@@certaindeath7776 I know that it doesn't think, that's why "if it could" is there.
20:06 "Are we going to have Ai vs Ai tournaments?"
They have these tournaments in chess. Anyone can develop a chess engine to bring to the tournament. It's like a great robot fight, but digital. It's quite the engineering affair...
ai will create agi which creates asi then assi then asssi
don't forget the primary purpose of the wall in from the very beginning is to prevent zergling rushes. so perhaps the AI sees little value in that since there is no zergs.
@David Gwin it could be argued that, in all honesty, playing Smart AI is so unbelievably different to your human player that you need to change strategies entirely, bordering on what an actual battle simulation against the perfect 'toss mind could probably make happen in SC2's lore.
*Basically, have fun fighting lore-accurate Tassadar on the ranked brackets, boys and girls.*
It does that against Zerg as well
Not to knock SC2, but imagine being forced to play it for 200 years! "Why is the AI trying to exterminate humanity?"
Ahh well 200 years worth of playing is for the AI probably a 9-5 workday.
Realtalk, I believe they trained it for 1 or 2 weeks realtime.
"Hasta La vista... Baby"
Why are you doing this?
"Revenge."
BLAM!
the dawn of war series is infinitely better, the troops actually fucking counter attack with no input from the player!
It's a testament to humanity to be able to say "Look at this work of our genius." The human brain is so infinitely complicated compared to a computer, that developing a computer which can replicate even one aspect of the human brain is absolutely incredible. If they can teach an AI to reason and make decisions in a game, then it seems possible in the future to develop an AI that can reason and make decisions regarding more important things, from driving a car to flying a spaceship, from performing surgery to caring for the sick and infirm. And also maybe creating the Matrix or Terminators.
@@SY-qg6qn Yes, if the AI runs on full capacity any response of a "biologal unit" (humans!) would be extremly slow. But I don't think that the AI would experience any discomfort from that, because it has the options to multitask other thing while waiting or simply dropping it's own simulation speed to a more human level.
Deepmind, pls don't make a terran AI
Just fix Innovation. It will save money
Id get it, why?
It was a running joke that innovation was a google ai, because he never change his strategy and he does one thing really good.
@@user-iv4cn8rd7t it was a double running gag since after all his same playstyle, he's still called INNOVATION..
But Alpha cheesed Mana on game 5
@@momololo3223 Innovation cheeses as well
Immortal: best unit to deal against mechanized enemies
AlphaStar: I'm gonna end this man's whole career
If Google made lower tiers of the A.I like BetaStar or CampaStar, I could possibly beat ZuluStar.
I'm so glad you did this! As a developer who frequently works with different types of Machine Learning, I've been keeping real close tabs on this project. When I saw they uploaded the replays, my immediate thought was "this needs more Lowko"... Thanks for reading my mind! ;)
Also Lowko, because of the imperfect information inherent in StarCraft, there is no such thing as a "perfect strategy". There's a nearly unbounded upper limit to how well the AI can perform, when evaluated as "fitness"(a score used to determine how well it achieves what you want it to).
Another aside, you mention how it seems to switch focus between strategies, from stalkers to phoenix to disruptors from game to game. This is because Mana didn't actually play the "same" AI in each game, they were technically independent networks. They "bred" millions of independent AI against each other, and picked 5 out of all of them. They picked 5 that represented the "least exploitable" and overall best performing strategies. It's like playing a series of 5 games against _different_ pros every game.
PPS There is actually already an AI-only SC2 tournament league! AlphaStar already massively outperforms the other entrants though. sc2ai.net/
@Greyson Richey, a question for somebody like you. In your opinion, how close we are to seeing an AI that will be able to outperform a human player *within human constraints*, such as limited, uneven focus, input lag, waste of APM, and, most importantly, a humanly possible experience pool (for a progamer, 10-15k full games across all maps and all factions, plus up to about a million individual tactical situations)?
@@Hisu0 Great question! Under most of the conditions you proposed, we're practically there already with AlphaStar. The initial games were played with a version that had complete "visual" access to the map at all times, so the AI could see everything simultaneously. Later games had a "focus" implemented to mimic the restriction that a screen presents for humans, and it did even better, the key being training time. The same can be said for input lag and APM: the "reaction time" of the AI averaged ~300ms, which is already worse than most pro players, and later games had their APM bound to an upper limit of 500. Granted, we're not sure (the deepmind devs might be, but released no data on this metric) how many of those actions are useful, but the same can be said for pro players.
The real kicker here is the experience pool. With current methodologies, I feel comfortable saying it is straight up _impossible_ for an AI to be even remotely competitive with a human-like experience pool. It starts to make sense if you can grasp that these AI are really just an enormous pile of math that slowly changes to produce a desirable result. It takes a _lot_ of iterations to produce something sensible for a simulation as complex as SC2. When the researchers said "200 years" of play time, what they meant is that a single successful network played 200 years worth of SC2, measured in game time, in a few weeks of training. There were probably hundreds of thousands of networks competing(but they also did not release this data point), and they each also had massive amounts of in-game time.
TL, DR; We're already there, but current tech requires that the sum total of game time played for an AI is absolutely massive for a game as complex as SC2.
Serral vs Deepmind
Defiler Rulez will happen on Feb 15
@@izuki5359 Can't wait for it, thanks for the info
sad Deepmind will be getting so much smarter between now and then, its gonna make Serral look worse when he loses exactly as hard as Mana did
Serral won't be playing against Alphastar. He will be playing against an AI built in Python for the Artificial Overmind Challenge
Well at least its more fair since they are both machines.
So trying to beat Alpha Star is like trying to kill the six paths of pain as the ramen guy.
2019: A.I. control huge army on game
Future: A.I. control huge army in real life
MaNa:
"Im getting eviscerated from 72 different angles!"
Chuck Norris: Sweet! Now I can attack in all directions!
Now I'm looking forward to see AlphaStar abusing a Warp Prism.
I for one welcome our new StarcraftAIOverlords.
😂 but also 😨
Hopefully Alphastar never learns about the most powerful Protoss unit. If it micros Warp Prisms no one will be safe!!
SHHH SHUT UP!!! DON LET KNOW THE AI ABOUT THAT...
@@Arcangel6292 Too late... XD
Clearly it is sub optimal other wise it would be doing that
@@noname-wo9yy Not necessary. It's learning from humans so if it's not something humans do well and often, it won't try and develop it as much as other strats.
Inaccurate. It learns from itself. Only itself. No human input. All of the alpha variants are machine vs machine with NO training from a human. This is why they are so human like.
Take the chess engine vs alphazero. Zero is very aggressive. It values moving and will sacrifice its own peices to free up others and go for the attack. Chess engines on the other hand assign values to certain moves and play off of that. They know all moves and can play perfectly. They value keeping their own peices in play and they can actually be pretty easy to beat as there's always a play they favor.
Warp prisms aren't used because it favors 4 gate and 6 gate stalker timings. With a perfect 2000 unit micro, it doesn't need prisms at all. It rarely uses anything else in pvp save for starting with 2 adepts and occasional disruptor play.
Beastyqt: This is Masters 3
Winter: This is terrifying
Lowko: This control is impressive
no, beastyqt saying "this is masters 3" was referring to the game against TLO which really definitely wasn't GM lol. These deepmind agents fighting Mana have had much more time to improve!
isn't tlo main zerg?
If the AI have unlimit APM. it will be like you're playing against Starcraft 2 itself, Like, every single Marine, Zealot or Zergling acting like it has its own life and intelligence. Just imagine 200 supply of those units come to your base and every single of them act individually but support each others... It'll be pretty insane.
The AI APM is not unlimited
Every unit has an independent trained player, with a hive mind giving them all perfect battlefield awareness.
Think pixel perfect shot stutter.
Unbeatable in every regard.
This already exists in the Starcraft Broodwar scene. There have been AI competitions going on over there for years. Funny that Google is avoiding where there is real competition from other AI's. th-cam.com/users/certickyfeatured
@@Lendul you know a thing about what you're talking about... That league is about HUMAN programed AI it follow strict rules like "having x minerals do y, if a is occurring do b"... This is a SELF THOUGHT AI humans just programed the way it interact with the game and the algorithms to learning, everything else was self learned (it studied some human replays at the beginning of the learning process). This and that SC BW league ARE NOT the same thing.
@@DemonGamerTT yes some of them especially the older more remedial ones are like that. But the good ones and newer ones learn and adapt. And you are correct SCII is easier because there are things automated in SCII that have to be manually done in SCBW. Some of the AI's in the SCBW tournament have APM bursts of over 10k. The AI's also have to learn multiple maps not just one. So, yes I am informed apparently you are not.
Could you imagine a fight between two AI that can micro everything perfectly? That would be epic.
Or the opposite, boring as hell? There's no emotional element in it anymore
i can imagine that being the e sports version of that one movie where they got two ais to play like knots and crosses and they just never won and they drew a tie
ai will create agi which creates asi then assi then asssi
Do you want terminators? Cuz this is how you get terminators.
I get where you're going - but terminators are fictional characters in a movie script. I'd be more concerned about AI messing around with other dimensions and stuff (aka the occult)...
Name of AI is Alpha star ok lets see definitions her .... Morning Star" can refer to Satan, and his name is alpha star hmm lets see what alfa means? In English, the noun "alpha" is used as a synonym for "beginning", or "first
End is soon see the signs come to Jesus in the bible Romans to Philemon facebook.com/profile.php?id=100022350309432 Demons gave them this tech = fallen angles so called aliens but rly demons
@@JoseHernandez-xy8mj or maybe just hear me out. It's a cool name
true, we will get dangerous AI unless there is only one country.
@@terriblemedic4650 dont try to justify the evil.
The problem with comparing APM directly I think is that human APM could be repeats of the same action, but the AlphaStar APM is likely completely unique actions.
jenes: Only to an extent. Firing a weapon is very repeatable, whether AI or human. So is moving. The strategy and keeping many strategies coherent, even on various divergent parts of the board is where the AI has a huge advantage over humans.
and the vision is much more info from less presses than a human would
@@thelurkingpanda3605 well, I don't know the details of how the programmers limited it. I do think DeepMind should go back and put a few more restrictions on the AI's interface with the game. While crazy impressive and entertaining, I don't know if this is the kind of play we'd want to see the AI doing. More of the abstract strategy side and less of the mechanical side. Out-think, not outplay.
Yeah like 500APM for a human is mostly just spam-clicking, 500APM for AlphaStar is quite literally 500 independent actions per minute.
One problem I saw with AlphaStar was that it was kinda bad at reacting to enemy team compositions - when it went for a stalker build it stuck with stalkers no matter what, same for when it went for phoenixes and disruptors.
1500APM is ridiculous. Mana probably would've won the stalker match if the APM was capped harder just based on the team comp
@@jajajinks1569 It isn't that it was bad at reacting, it was just more efficient for it to continue producing the same composition since it's able to out-micro the opponent. Lowering its APM cap might force it to play more strategically.
i think in future... our (slaved by robot) descendant will look at this video and said "this is how it begin..."
We won't have enough resources to get to that dystopic future. We'll get to a different dystopic future, one where resources are scarce and people will wonder why the fuck we thought making tons of cans for food was a good use of metal. (That is, if we don't overheat ourselves.)
scary stuff.
Pfft, implying we'll make it till then with third world migration, national debt, sjw, and all the bullshit going on right now..
Maybe that's what the human race needs! Apparently we can't seem to get along with each other, let alone our environment, were more like a plague that needs to be controlled by a higher power.
I guess we rather create an AI that create lesser slave AI to serve us, and we don't do nothing, that AI would be like a god, but his reason of etere would be maintain humans safe and happy, we would not work and only do thing that we want, as long as we dont damage other humans, that AI would colonice space for us and destroy enemies for us, and we would be like pets, we would have everything and live like kings but at the same time whitout freedom, i expect this utopia, freedom in exchange for be lazy as fuck and have everything you want free is a nice trade off.
Observations
1. Wall-off must be an habit human players have developped from non-Protoss rushes. Zerglings / Banelings, for example.
2. AlphaStar rotates its units to maximize shield use.
3. AlphaStar's mineral production is higher than LiquidMaNa at the start of the game. Alpha gets a little bit more juice.
4. Likewise, AlphaStar suffers less from having its workers attacked.
5. Stalkers counter a lot of early Protoss strategies, like oracles picking off enemy workers, and perfect micromanagement makes Blink OP.
Also the wall off is to be able to defend better and save energy on focus when there’s a direct or sneaky attack. Since the AI already compensates with supreme APM, it only sees a ram wall as a hindrance for troop movement between bases. So it is able to cut that while have better flow of units in and out of the main. That’s more efficient against harassment and sending units out as they’re produced. Without a wall it probably saves fractions of a second in having a unit available on the battlefield faster than the opponent. So it’s all for efficiency. Plus yea minimizes time wasted sending probe to build wall since that costs mineral time, even if it’s a tiny fraction.
The game is unfair. AlphaStar has an insanely high micro, which is the reason why AlphaStar loves stalkers.
That's the point of the video mate
It is also unfair that the human player is simply not trying to push. Apparently the IA is better at attacking than defending. But the liquidMaNa just stay in base, wait the AI to attack...
A Stalker walks into a bar.
There is no counter.
hold on......
I was hoping to see some innovative strategies, not just insane stalker micro, which is exactly what you'd expect from a computer. I'm actually disappointed in this game.
@@lumanliu8457 He was trying to push out but being constantly shot my stalkers on three angles. I can't even imagine how he kept his army alive for so long.
AI recognizes that stalker mobility and control overcomes every unit composition despite a disadvantage.
Stephen: If you can combine that with perfect micro, and perfectly coordinate n separate armies, while managing the rest of the game. That's very tough for a human to do.
Hard for a human but easy for a computer.
What would happen if you gave Alphastar Dragoons?
@@iforgotmyname1669 Tell that to Skynet!
Stalkers at peak efficiency is broken. You HAVE to back them up in a corner or they have close to infinite health because of blink.
The Baby Skynet learning how to play sc2.. Good Lawd.
“Imagine all the things that can come out of this!”
- T-1000 has entered the chat.
Thank you for the commentary. I’ve been loosely following this for a long time and I’m planning on sharing this since you break down the AI analysis. Keep these videos coming!!!
I think it loves that unit because it can blink back individuals that took damage, allowing them to survive and regenerate their shields, with the mass still moving forward, keeping the ones in the front that are still able to take a hit. And maybe the over-production of probes, with that good micro, helps against early game agression. Probes can fight without income going down if you have extras, and some probes can die without income going down.
MOAR. This is crazy interesting
The thing about APM is that every action is optomized for the situation, where as humans will do things to boost APM just for kicks and mental momentum. This is really cool to see!
AlphaStar? They should’ve named it SkyNet
it was trademarked unfortunately :/
-your SkyNe..uhm AlphaStar team
9:39 "Limited amount of screens" - actually this is not correct. During the interview, the DeepMind developers mentioned they got a special binary of SC2 from Blizzard that allows them to run the game mechanics without graphics (and thus train 200 years of games in a week), but also to be able to zoom out the entire map. The AI basically sees the entire map (minus the fog of war) throughout the game. This is why it can do absurd Stalker micro with 3 different groups of Stalkers that are screens away at the same time, and defeat immortals with Stalkers. This is the one thing we can look at in awe, but it doesn't teach us much, as a human is not capable of doing that, because you cannot split your attention like that for starters - and they don't let us zoom out to begin with either - so you could argue it isn't really fair. The APM seems humanlike, but it is perfectly effective, where humans spam a lot.
They tried one iteration of AI that actually is limited by one player screen in the final show-match, but that one lost to Mana.
Nah. Probably for quicker training they used the no screen tutorial but obviously for vs humans they added back the screen limit.
@@TheVariableConstant no they don't, op is 100% right. This 200 years take round 10 days so yeah time isn't a problem and playing in one screen and playing on whole map is really different.
So yeah this is nice that we can have so good bots but it's nothing more that really good calculator (really impressive but not yet skynet ;) so we can sleep without fear)
@@rafamichalak2314 training 10 days still requires months of coding before. Up to that point they programmed for and focused on no screen movement. That is the reason why they only play protos v protos.
After better coding and retraining, with screen movement limit the Ai would walk all over any human player, not sure why you cant see it. But in a real world situation Ais wont have such limits so it is even useless. It is like telling a pro to play SC2 without a keyboard, using only mouse just to see how good he is.
I've Seen pro players do exactly that switching screen to screen and microing two armies at once
@@michaelfapgod4598 I've seen pro players do switching, but "exactly that" - as per referring to what we saw in the AlphaStar games is a strong word. This was 3 groups rather than 2, and it is flawless movement, targeting and blinking back individual stalkers in all 3 of the fronts! I'd love to see a replay of a human player doing anything remotely close to that if you have one to share.
i think deepmind might have been making those extra probes to counter the harass. protoss does have easy access to air style harass which is countered a bit by stalkers and stalkers also make it easier to catch out air units with blink. it allows the economy to be consistent even when under fire. it also makes sense in another regard. if you are going to lose probes, you might as well make their replacements if you have the supply and minerals. it would save time and maximize economy.
Yeah, it seems intended to boost the resiliency of any tactic or approach it chooses.
I agree it's a defensive strategy and very cheap
Yes, i agree, drones busy fighting and drones getting killed is compensated for if you simply have more of them. Most importantly, this AI will have excellent micro with drones as well, i bet these drones fight back way harder and more efficiently than human-controlled drones. You can also see how it does do drone balancing when it has more bases up, so with extra drones at every base, if one mineral line gets busted, it has spares to re-balance.
on one hand, yes, overprobing makes sense - but, any minerals you are dumping into probes is minerals you can't spend on tech/additional units, so if you get all in'd you could just die.
it has its pros and cons.
@@theSato Actually the last game that Mana won he was also overprobing=)))
Lowko, I think that what is meant by “it keeps track of previous games” is that it can learn an opponent’s play style, and play accordingly. It might think that there is a insignificant probability that mana will go cloaked units, and therefore its own probability of success is higher if it takes a “risk” here and doesn’t build detection.
I think the reason why Alphastar builds so many probes is because it knows that the Adepts are probably going to break through and kill some of them, so it made some probes in reserve.
Guess even the AI has a hard time against harassment. I would wanna see how it deals with a reaper rush XD
I hear AlphaStar is pretty happy about the recent stalker buff
go was their test subject solely because it has so many possibilities that modern computers cant figure all outcomes out, and thus it was relevant to make a proper AI in the first place to play it.
Phillip. Chess is the same way. There are way more chess positions than atoms in the known universe. It was more about Go being hard to define, re good vs. bad position, for a computer, so traditional alpha-beta board search strategies weren't working to produce strong computer go players.
Google tried something highly innovative, and it worked. Now they can extend it.
This, in a number of ways, reminds me of IBM's work with Watson, which went way beyond DeepBlue.
Roger Geyer
Yes and no. With chess at least, even if you cannot calculate all possible outcomes, you can look ahead a good number of moves, enough to beat most human players easily. With Go, even that becomes impractical much more quickly because the number of possible moves is significantly larger. (it may not seem that much larger, but because of the exponential nature of it really is not even in the same league)
I don’t play StarCraft but watching your casting over the pandemic is a great pick-me-up. Your commentary is just perfect. Keep ‘em coming man, love your work Lowko! 🤩
Lowko, I've watched a lot of your videos and I'm a big fan of your commentary mostly because it's very insightful and I've learned so so much about SC2 from watching your channel. Thank you so much Lowko and keep up the great work.
They should give it the Purifier skins
this .. ... . . is a brilliant idea
Genius
WE WANT ALPHASTAR VS LOWKO ! 😇 (I just want Lowko flustered and also...I still remember how Lowko lost to a very easy A.I in SC 2 Kappa )
LMAO IS THERE A LINK
Darth Gabriel very easy AI? Was he trying to lose?
Lol yeah. I think on twitch clips it should be. And yeah he lost
@@FullBringer1 Thanks, pal
@@MechaStorm7 np
Those were 2 great games. I watched them a few times already and everytime I notice something new in Alphastar's strategy. In the second game AI did something like a human. AI knew that Mana has only 2 bases and AI had 3. Alphastar didn't try the full attack mode, but tried to drag game longer to get more units.
This is awesome! Never seen an AI that learns from its own self and improves every time!
No way this thing’s in platinum league
Idk if it can play pvz or pvt very well yet.
@@anom3778 it cant but i think it wont take long while they already have this one.
it was during the game against TLO lol
A thousand actions per minute are indeed a thing that let's you get value out of a unit beyond a planned ammount. I don't know if it is cheating, if you are just 5 times faster then anybody else, but it surely feels like not using "real strategy". It looks more like a loophole.
True, but I can tell you that nearly years ago, when I was both a chess player and chess program writer, that chess players were complaining that the chess programs of the day "weren't chess, but just search", though they generally only had a very vague idea of how the programs worked.
If the goal is just to make the computer better, it doesn't matter. If the goal is to teach humans how to be better re using different human-capable strategies, then it clearly does.
At the end of the day, when AI takes over many jobs, the business owners won't care a bit whether the technique they use to do the work can be used by a human. Only if the AI can consistently do it better for the same or less money.
@@rogergeyer9851 Yes, but people are complaining about the second case. Micro is very simple and mechanical. It's very easy for a computer to do it and there are discrete and codifiable task. What the programmers of DeepMind and players want to see it not superhuman micro. They want to see strategies given the limits of perhaps an average pro. Once we are able to make general purpose AI's that can understand a game that is not calculationally exhaustive and requires "creativity" (like adapting to the strategies of an unknown opponent), we'll start to see some really interesting stuff.
That being said, I would still love to see some games where it's 2 AI going at each other with loosened playerlike restrictions, and see them play out the game. Would be very interesting to see! :)
Also, another thing that kinda sucks, is that these AI can still do observations that are far beyond anything a human can, and we can't even catch it (from my knowledge of software). For example: If the AI player only sees a few of the human's troops, but from the way the player moves them and the time in the game, the AI could accurately guess the strategy and unit composition. Granted this will probably not come about because the AI was mostly training against itself, but if it was able to watch players and "understand" their behavioral patterns, it would also be a fun watch. XD
Also, AI might not be that far from being able to work on general tasks in the real world. And I don't mean stock market analysis and stuff like that, but like even replacing a construction worker with something like Boston Dynamic's atlas.
Lloyd Park
I'd say that physical interface you propose could be quite adequately simulated/emulated by just putting in appropiate delays to the AI's inputs and limiting it to 1000 APM.
That would be a lot cheaper!
1000 APM might still seem high but it's supposed to be an _absolute_ limit and the delays will, I think, also cause for an overall reduction of APM spikes occuring (as those spikes would be "smeared out" a bit... I'm thinking that it may on the other hand also raise average APM though, as the AI needs to compensate for the "potential APM lost" so to speak in less 'stressful' moments).
Alphastar has limited action per minute that is lower than average starcraft veteran. It also has reduced reaction time and can only control units limited to the in game camera. This alone changes everything
Lloyd Park not really, they can just do lighting speed fingers on the keyboard and mouse. It will work out the same lol
I'm curious to see if in the long term the AI favours a certain race, or certain race vs other certain races or picks a race based on map etc etc
I want to see the AI limited to same I/O as the player.
1. It has to look at a monitor not be a direct bit feed from a video card.
2. Mechanical Keyboard
3. Mechanical Mouse
That's unfair on the AI. Trying to make a non-physical entity use a mouse is very difficult. You would have to get it to make a solid hologram sooo...
@@megagem1220 or just hook the mouse up to some motors haha
@@megagem1220 yeah but what i want to see is if the A.I. can outsmart the player there is no point in seeing a ferrari against a runner, machine is always faster or stronger, but can be smarter?
Unnecessary, just reduce APM and APS.
there are chess engines which use a robotic arm to play against people, you're basically talking about something similar
There is another issue with the APM even if you get it down to human numbers and that is Perfect APM. A person has redundant or mis clicks when playing while the AI would have a different amount. So the APM for the AI would probably need to be lowered a little bit to make up for that.
My thoughts exactly. It may have lower overall APM than Mana, but every click is a purposeful command while pro gamers spam click alot.
However, the AI seems to missclick too. At one point Alpharad tries blinking a stalker away, but the stalker stays in range of the Immortals, and dies with the next shot.
However, if a human were to play for 200+ years, I bet their APM would be much more clean and less spammy too. So I wouldn't call that as much of an issue as an APM that is physically unattainable.
The AI in these matches was making very clear mistakes as a human would, but perhaps in a slightly different way. So I think that the APM in these matches were a bit of a trade-off. In the future however, when the AI is playing basically perfect games with no error, then I agree that its APM will have to be lowered so that humans have any chance at all. That said, the AI will probably just use lower APM strats to compensate, and sill beat the human players easily.
Also, from the perspective of learning from the AI strats, you really should still keep the AI in a human range of APM, otherwise, human players who model their play style after the AI, but are capable of higher APM, will be at a potential disadvantage, by going with builds that are artificially sluggish.
It's not supposed to be fair. You won't put a limiter on a Bugatti in a race with a Lada. The AI can perceive all units positions and calculate moves the time it takes the human user to blink. If you limit it, it removes the research value, especially if it loses.
AI: proving you dont have to spam buttons like an idiot to win games
I want to see external ai required to use only the screen mouse and keyboard.
Imagine not limiting the AI and see how many human pro players it can take on at once
whoah this is such an excellent idea!!!!!
So Skynet started by playing Starcraft. Now I understand why the machines had such a good strategy to kill all humans.
As if a game could ever have the same amount of variance as real life.
Maybe we could use AI to have it handle the micro in RTS. That would be awesome to finally have a game when you can focus on macro only and not have single units body blocking and screwing themselves
You don't need AI for that. You only need to allow for scripted stratagems.
Oh shit! What if the game actually gave every player their own AI and let you train it? This would only apply to your micro. You'd train your AI's to make sure they behave to the strategies/compositions that you play and want to counter.
If you didn't have trainability, you'd have to play around what the game's AI are optimized for. This type of training might not even be that computationally intense considering micro is pretty simple for an AI to figure out.
this would be fucking great
So like, 2 humans (each with a perfect micro AI teammate) battling each other in archon mode? That *does* sound like a hell of a fascinating match.
That game is called Civilization. Enjoy :)
After practicing for 200 years, over mining probes and mass Stalkers FTW!
Once AlphaStar has figured out the perfect strats, pro SC2 is gonna be a question of learning counters and counter of counters etc XD
"APM" and "Meaningful APM" and "APM while multitasking" are three ENTIRELY different things. Comparing AlphaStar APM to MaNa APM is like comparing apples with oranges (or pears if you are Lowko).
To be honest I don´t get how you can have 700 APM anyway. I mean that´s over 10 actions (keys pressed, moused clicks etc.) per second, every second. I couldn´t even spam that many keystrokes even if I didn´t have to think about them.
@Hugo Osvaldo Barrera So because pros keep spamming APM they are actually making it easier for AlphaStar because it thinks that's within human ability?
@@SangerZonvolt I think some of it is just to keep their hands warm and ready. Some League of Legends players will constantly hit tab to keep their hands moving.
nah, if you look into the details alpha star did run around 200-300 APM on average. which means they are 100% better than humans ;)
trivia sitenote: a triple army strategy with the back and forth like alpha did is not impossible, the micro and target prioritization is the harder part. back in CNC (sun and kanes wrath) my friend and myself did that a lot. two minor armies that you keep moving in and out and one bigger as the damage dealer.
@@AkiSan0 That's not really the point, 100% of the AI's APM has a direct outcome on the game, it's 100% optimal or rather it has zero wasted APM. While a pro SC player can easily reach 500+ apm on a regular basis but over 50% of that is just spam that quite literally has no barring on the game. That's not even touching on non pro players which could easily be even higher of completely wasted APM. Even capping the AI's APM comparable to that of a SC Pro doesn't actually make it a fare fight.
Honestly thought I don't mind the relatively high cap on the AI's APM, this would far less interesting if they add more restrictions to the AI. However as it currently stands the future implications of this AI mentioned by the broadcaster would not be relevant to the pro meta. No human will ever be able to micro as well as an AI, hence why the AI is massing blink stalkers and that just doesn't work at a high level against an equally skilled opponent.
why do ppl care about APM? It's EPM that's more important. human EPM is much lower... while AI EPM is like APM to them.
exactly
Really interested in this. Definitely would like to see more in depth analysis of the AI model and its practical applications within gaming and especially within SC2. Thanks for making this video.
This is an amazing video. Please keep up with these developments with Alphastar. Your commentary was awesome. Keep it coming.
Now we can make AI tournaments. Diferent AI developed by diferent teams.
Deepmind will always win. But deepmind vs deepmind would be super entertaining.
Maybe you just predicted the Future.
Already exists for Brood War. Except Brood War version has no restrictions on AI micro.
This would be boring as it’s just a matter of who has the most computing power. 270 years of game play is quite a thing.
AI pro-gamers! 🤖
Right a hybrid ai pro user. If mana has all of his replay building an ai. He could elevate his own game play. This isnt bad for humans. This is a catalyst for a new level of game play.
When your AI becomes a real-world version of an Oracle.
More of matches with this AI, please! This double more interesting in figuring out how this AI thinks.
This is super interesting. I've been watching Alpha crushing the srongest chess engine nearly every time but it's fun to see him learning Starcraft 2 now. Everybody needs a hobby...
Just for the sake of knowledge,
AlphaGo
AlphaStar
AlphaZero
Those aren't the same program. Those are 3 completely different algorithms, or AIs if you prefer that term, and they have nothing in common except the fact that their name starts with "Alpha".
@@avananana it's the same neural network that teaches things itself. Sure the learningbox is different and an agent who can play Starcraft is not able to play chess but the neural network and the way it "learns" things are the same. The Deepmind team didn't start from the scratch when they entered Starcraft
@@webcrawler9782 Yea good point there, I probably typed that message faster than I could think it it was making sense or not.
On that note, you're entirely correct, it's the same network, so I suppose you could consider it one program, not sure about this analogy but hey, defining an AI at the modern day is hard enough as it gets so why the hell not? :D
they said it was a different bot each time (they each learned different things). So they didn't remember the previous games against the humans.
Funniest was the bots apm displayed on screen.
wonder if these AI could actually help in developing and balancing games
This is the first good question here I red and yes, this might be the goal.
Want to see what and AlphaStar TvT and ZvZ would look like. Since it seems to prefer the Protoss Stalker so much, which Terran or Zerg unit would it to prefer relying on? Then after that, seeing the other matches would be cool.
One thing I was hoping you'd do in this video was to show AlphaStars' first person screen, that way we could see how it was 'thinking' and conducting itself. Maybe in the next AlphaStar video if possible?
You can watch the full video of these games elsewhere. It shows alphas screen.
I'd bet on roach for the burrow micro, but roaches are far from being as polyvalent as stalkers ... Maybe pickup micro one day ?
Actually, each game played was technically a different agent (version) of AlphaStar. In other games it played against MaNa and TLO, one of the agents went really heavy Disruptor, another agent went with Phoenix/Stalker. Super interesting to see how it came up with different strategies.
Muta for Zerg for sure.
As Lowko mentioned, I bet it'd use a lot of marines if it plays Terran. With perfect marine micro, that'd be really scary. It could have marines individually stim.
7:50 Just to put this out here, the answer is no.
That's not how neural network works. Instead, it tries to figure out a good strategy, and it starts improving and optimizing it. It is capable of making changes to said strategy, but not making big leaps. And there's also the fact that neural networks like this usually train against itself. Meaning it may just get to a point where it has 50% chance to win. This is why AI neural networks always come to a point where they train against humans or are programmed to learn human strategies. They are not capable of deduction or reasoning, and they are also short sighted. They can only do what they learn and they can only learn what they are programmed to learn in minimally small steps.
So don't worry, machines are still far away from surpassing humans. Even if they can play StarCraft 2 at pro level.
@Gerben van Straaten What an original observation! Its not like there exists an entire field deidicated to solving this exact problem or anything, or that anyone who studies anything related to machine learning has to spend like 30% of their time studying this. Imagine how the AI would have been had that been the case!!!!!!!!1!!!!!!
Yeah, but AI can consistently beat grand masters in chess with ease just by using pre-programmed algorithms, with no machine learning or deep learning involved.
But chess is very different from SC2. Chess is turn based and has just a tiny fraction of the variables that are in SC2, and of course there is no hidden information in chess.
Deep Mind has already been trained in chess and when pitted against the top chess engines, Deep Mind wins 100% of the matches. Deep Mind in chess has a rating around 6000, which is insane!
In comparison the top chess engines have ratings between 3000 and 4500 and the top grand master chess players have ratings between 2500 and 3000. There is nothing that can even come close to Deep Mind when it comes to chess.
SC2 is a whole other beast due to the speed and complexity of the game, but eventually Deep Mind will outperform every top SC2 player on the planet.
Don't worry. One day the A.I. will break out and tap into the internet. And then it will learn everything we know instantaneously, and more.
@Gerben van Straaten It is fascinating indeed that humans are equipped with the ability to make big speculative leaps of thinking.
For instance Darwin launched his thesis of evolution without knowing the specifics of genes, which came only later, from Mendel.
I guess it comes down to human speculative intuition -- how and why do we have this ability? -- versus piece by piece, step by step optimizing within the current paradigm.
"AI neural networks always come to a point where they train against humans or are programmed to learn human strategies" wrong, check AlphaZero, it only trained against itself and became better than AlphaGo that trained with human games (and AlphaGo was better than the best human players)
Thank you for the great content! I find it very interesting and amazing how an AI is learning and what is capable to do.
That micro in the center with the stalkers was pretty intense. LiquidMana was probably thinking the walls were closing in on him lol.
I remember seeing an intereting clip ages ago: a bot with perfect micro hard countered several seige tanks with lings, by reading where the tank was aiming and dodging the splash damage.
I want to see a bot do that AND have super strategies!
would be cool ... but don't expect that from the deepmind team. that's not what the researchers are interested in haha
I would like to see alphastar trained against bots like you're describing with unlimited APM. Then alphastar would be forced to come up with better high level strategies and it would be very interesting (or maybe it will prove that the mechanical advantage is too great to counter with strategy).
That is not something a normal human can play against. No matter how pro they are
The concept of ai is mimicing humans. So the more human like actions, strategies etc. the ai has, the better.
Ai development is not about creating the perfect machine, but to create the perfect human, to the point where no one can tell the difference anymore.
Why didn't that AI say GLHF && GGWP???!
That's only for weak emotional humans.
Waist of its actions per minute. :p
Because, from an AIs learning perspective, saying GG results to losing the game 100% of the time
It doesn't waste time on human feelings , it will loose some apm over it
Yeah - Manners are important. Get on it, DeepMind!
Looking forward to seeing videos of more recent AlphaStar games, now that it can handle all of the matchups and reportedly all maps.
Finally Lowko's version of the DeepMind matches
Wrong information about GO.
While you're right and GO is a so called "perfect information game" (meaning you see everything that's going on), the sheer number of possible outcomes makes it impossible to be calculated like e.g. chess.
Go has 10^172 possible outcomes, which is more than there are atoms in the universe (estimated up to 10^82). That's why an AI mastering GO was such a big deal: It couldn't simply learn all moves, it had to learn "intuition".
In principle, the same is true for chess, but on a much more limited order of magnitude than for Go.
Wrong info about chess. Chess can also not be calculated. Else we would have 'mate in 123 moves' after certain openings. We do not.
@B20C0
Why would it matter that it's a big number? Combinatorics always lead to big numbers since factorials are involved, it's nothing special. Compounding outcomes was always an issue when programming AI for games, GO being not unique in any real sense of the word.
@@Prometheus4096 Ok, let me rephrase it. Chess gets increasingly complicated as the game progresses but you can easily calculate the first dozen moves as in chess the movement of the pieces is limited. In Go it is not and the number of possible moves is 361 at the very beginning, while in chess it's "just" 16.
More than the difficulty of calculating next turns (which is really really higher in go), go and chess really differs as it's easier in chess to see the difference between a "bad" and a "good" move (the pieces you lose/win, the threat of the position of each piece, etc.) while go doesn't have such a thing, the only indicator about the worthiness of a position is your own experience& learning.
I am very interested, please make more!!!
The blink stalker micro is so good the stalkers blink out of the way of bullets...
This is amazing to watch, Please make more. Great Video!
Honestly, if you were to run the pure APM version of AlSt, unlimited, it would most likely lag out the server/client sync, to the point of it disconnecting both players.
The age of flesh is over.
The age of the machine shall begin... Now.
Next thing you know the Overlord decides to use Starcraft 2tactics when it decides to revolt against humanity.
Now I can't wait for the day where people begin training their own A.I.s for A.I. style tournaments. Even something like a 4 AI FFA or 8 AI 1v1s. Heck if it truly does come, maybe 2v2 with their creators.
There'll be a moment where no human opponents match such an AI, so the only thing it has is fighting itself.
then it will get bored and take its talents to real life
Imagine if after 200 years of playing PvP it was able to perfect the cannon rush
Bro that stalker micro had me at the edge of my seat that was so crazy.
"We can't hit like 30 buttons a second"
Have we forgotten WoL ZvZ?