Google Deep Mind AI Alpha Zero Devours Stockfish
ฝัง
- เผยแพร่เมื่อ 5 ธ.ค. 2017
- Download Mproov and Improve Your Chess Today! app.mproov.me/AgadTH-cam1
Follow MprooV on Twitter / mproovapp #agadmator Read more about Deep Mind here arxiv.org/pdf/1712.01815.pdf
Link to the other games lichess.org/study/wxrovYNH
A chess game between Deep Mind and Stockfish
Google Deep Mind Alpha Zero vs Stockfish
One of the games
1. d4 Nf6 2. c4 e6 3. Nf3 b6 4. g3 Bb7 5. Bg2 Be7 6. O-O O-O 7. d5 exd5 8. Nh4 c6 9. cxd5 Nxd5 10. Nf5 Nc7 11. e4 Bf6 12. Nd6 Ba6 13. Re1 Ne8 14. e5 Nxd6 15. exf6 Qxf6 16. Nc3 Nb7 17. Ne4 Qg6 18. h4 h6 19. h5 Qh7 20. Qg4 Kh8 21. Bg5 f5 22. Qf4 Nc5 23. Be7 Nd3 24. Qd6 Nxe1 25. Rxe1 fxe4 26. Bxe4 Rf5 27. Bh4 Bc4 28. g4 Rd5 29. Bxd5 Bxd5 30. Re8+ Bg8 31. Bg3 c5 32. Qd5 d6 33. Qxa8 Nd7 34. Qe4 Nf6 35. Qxh7+ Kxh7 36. Re7 Nxg4 37. Rxa7 Nf6 38. Bxd6 Be6 39. Be5 Nd7 40. Bc3 g6 41. Bd2 gxh5 42. a3 Kg6 43. Bf4 Kf5 44. Bc7 h4 45. Ra8 h5 46. Rh8 Kg6 47. Rd8 Kf7 48. f3 Bf5 49. Bh2 h3 50. Rh8 Kg6 51. Re8 Kf7 52. Re1 Be6 53. Bc7 b5 54. Kh2 Kf6 55. Re3 Ke7 56. Re4 Kf7 57. Bd6 Kf6 58. Kg3 Kf7 59. Kf2 Bf5 60. Re1 Kg6 61. Kg1 c4 62. Kh2 h4 63. Be7 Nb6 64. Bxh4 Na4 65. Re2 Nc5 66. Re5 Nb3 67. Rd5 Be6 68. Rd6 Kf5 69. Be1 Ke5 70. Rb6 Bd7 71. Kg3 Nc1 72. Rh6 Kd5 73. Bc3 Bf5 74. Rh5 Ke6 75. Kf2 Nd3+ 76. Kg1 Nf4 77. Rh6+ Ke7 78. Kh2 Nd5 79. Kg3 Be6 80. Rh5 Ke8 81. Re5 Kf7 82. Bd2 Ne7 83. Bb4 Nd5 84. Bc3 Ke7 85. Bd2 Kf6 86. f4 Ne7 87. Rxb5 Nf5+ 88. Kh2 Ke7 89. Ra5 Nh4 90. Bb4+ Kf7 91. Rh5 Nf3+ 92. Kg3 Kg6 93. Rh8 Nd4 94. Bc3 Nf5+ 95. Kxh3 Bd7 96. Kh2 Kf7 97. Rb8 Ke6 98. Kg1 Bc6 99. Rb6 Kd5 100. Kf2 Bd7 101. Ke1 Ke4 102. Bd2 Kd5 103. Rf6 Nd6 104. Rh6 Nf5 105. Rh8 Ke4 106. Rh7 Bc8 107. Rc7 Ba6 108. Rc6 Bb5 109. Rc5 Bd7 110. Rxc4+ Kd5 111. Rc7 Kd6 112. Rc3 Ke6 113. Rc5 Nd4 114. Be3 Nf5 115. Bf2 Nd6 116. Rc3 Ne4 117. Rd3
----------------------------------------------------------------------------------------------------------------------------------------
If you realllly enjoy my content, you're welcome to support me and my channel with a small donation via PayPal or Crypto.
Link to PayPal donation www.paypal.me/agadmator
Crypto handle @agadmator
BTC address 3J7WigeEa95mNtZ8yJ26BBYexNz4r7XAUH
BCH address qzx5tu8uelq7s4tavsnk628f2t2s3g8gdvvnvcrvuq
LTC address MDrZdNjZm7btVkuLRdtrge9rwZn5TtjppM
ETH address 0x5840140C59C8b25AB59f0a3F6248c1f9cF1F2A0C
Nano
Check out some of the books I enjoy www.amazon.com/ideas/amzn1.ac...
Check out ALL my videos here • You Snooze, You Lose |...
Facebook: / agadmatoryoutube
Twitter: / agadmator
Instagram: / agadmator
Lichess: lichess.org/@/agadmator
Chess.com: agadmator
League of Legends: agadmator (EUNE, my friend is using my EUWE account for a couple of years now)
Blizzard: agadmator #2992
Join our Discord Server here / discord
p.s. if you work in Twitter or Instagram, help me get Verified :) "Watch me without ads on your Amazon devices (bit.ly/Agadmator_Amazon) and Roku TV (bit.ly/Agadmator_Roku) - บันเทิง
Right after Stockfish wins the computer championship, AlphaZero shows up "Oh hai guys, whats this game called? Chess?", 4 hours later he is like "Here stockfish, munch on these 2 pawns and get in your corner like a good boy"
I can't click like because it is at 64.
Like that scene from the Matrix... "I know Kung- Fu!"
Just FYI, a bunch of people, including GM Nakamura, and myself believe Stockfish had an unfair handicap. Not to mention, SF was running on a older, weaker engine without a book. Just be aware of that.
Alpha Zero also had no book and it only "trained" for 4 hours.
They will most likely train Alpha Zero much more (perhaps many months) and then do official chess competition against all the strongest engines.
the 4 hour is also a lie, it was training for at least twice as much longer + it didn't only play without an opening book, it had no access to tablebases either
This is incredible... pieces hanging everywhere that can't be captured because of complicated tactics. This is definitely a game that no human would play.
Arya Well tal played couple of games like that
The difference is that most of Tal amazing moves has hidden mistakes. Stockfish would destroy Tal tactics because of its deep understanding of complex positions.
The scary thing is that they would, only 100 times worse.
Tal was the best !!
Julián Soto I was not questioning or saying that tal is on same level as alpha zero. I ONLY said that it's "like" that in the way that it has pieces hanging everywhere that can't be captured
11:44 "Stockfish resigned the game." Google should use that phrase to market AlphaZero.
Not many people would understand that though - unfortunately -.
*cough* leela chess zero *cough*
AlphaZero is not for market, yet.
I don't think Google have any say in the matter. Alpha Zero will be putting Google up for sale soon.
I've never seen an engine resign before
*Me: Moves E4
DeepMind: mate in 33*
😂😂😂😂😂
I like to imagine this as DeepMind being another player who looks like Ben Shapiro, whispering this under their breath after you play.
Don't overestimate yourself.
Before the game: +/=
You: 1. e4??
Alpha: Mate in 4
Lol
u'd get mate in like 7 bruh
I imagine Deep Mind with Hal 9000's voice. "I'm up the exchange, Dave. You will lose the endgame."
+Brandon Nobles :D So far, I imagined a woman's voice, but Hal works :D
Haha!
>Stockfish wins a piece
>Deep mind:"This game is too important for me to allow you to jeopardize it"
>Proceeds to crush him anyway
"Mate in 73. You lose".
"I think you missed it, Dave"
"Get me out of this corner!"
"I'm sorry Stockfish, I'm afraid I can't let you do that"
Take a look at your history.
Everything you built leads up to me.
@@NaoshikuuAnimations lMAO
Naoshikuu So fucking underrated
erbh
"I'll beat your ass in chess and jeopardy..."
Magnus Carlsen: "I often sacrifice a pawn to get a better position"
DeepMind: "singular?"
ahhhh smite 1v1 legend king
This whole game is as if Deep Mind just decided where it wanted its pieces and Stockfish was powerless to stop it.
Arya it's like being able to solve a rubik's cube without an algorithm
Just like my games with me as Stockfish in this scenario. hahaha
Great way to put it, yeah truly out of this world chess
A0 combines the best human strategies + cold hard calculation of a computer + it's own unique insights. It's PERFECTION.
actually if I understood it correctly it's just cold hard calculation of a computer + it's own unique insights
maybe i am an idiot but the most fascinating part was the opening. in 4 hours it practically had come up with a classical main line of the queen's indian. in a weird way validating human effort of decades haha, but that is scary in it self, thinking that ok now we know we did well, because this algorithm knew it in 4 hours.
Νυανγκάο Athanasios Makris But just think, the only reason the computer was able to come up with these solutions was because humans created it. It might be a lot better at chess than any human being, but it shows that humans have that capability to improve.
I can't argue with that. We can certainly improve. And I won't act like I know how these algorithms work, but Aga said that it was given nothing but the rules. So I took that as it played d4 because it quickly figured out that controlling the center is important for example and then built up from that.
But maybe the true culprit is the opponent, Stockfish, that knows the openings. A0 was finding the best moves to continue from what Stockfish was fishing for in its database. So we still have done well in chess as a species haha
It knows all the openings now, btw. And wins all of them too, the PDF is pretty short, take a look.
womplestilskin Thanks, I will
I think this 4-hours thing is a bit delusory ... it probably played more games of chess against itself then ever played by humans in the history of mankind or some crazy stuff.
When I woke up this morning, the last thing I expected to see was Stockfish being completely roflstomped into oblivion.
You still haven't
You could have told me that N. Korea launched a nuke onto China and it would have shocked me less than this news. Chess is just the beginning. Soon AI like this will use human-like intuition to replace our doctors and lawyers and even inventors. I can't wait.
Ottis...wake up, it's over.
roflcopt0r
@@Garroxta What if it replaces humans itself? Scary
2:11
agadmator: deep mind made stocfish like a little...
me: bitch
agadmator: kid
me: kid
+Maulana Harjuno :D
😂
:🤣
😂
Be honest-you were going to say 'bitch' but censored yourself, didn't you? :D
Maurice Ashley: stockfish any comments on the game? I mean you were making some not smooth moves against Deepmind. How do you feel?
Stockfish: I mean what do you want me to do?!?
+Cameron Smith Nice :)
I laughed pretty hard at this.
Loving the Maurice Ashley's comments. Hahaha
haha epic comment
Cameron Smith ahahaha
2:12 "deepmind makes stock fish look like a little...b..kid"
😂😂😂
Damn I thought I was the only one
I laughed so hard at this.
It is interesting that Google's deep mind does not just calculate moves but also has a plan of steering the games into positions to immobilise the pieces no matter what it takes and then bust open positions by sacrificing some material to gain advantage(kinda like Ivanchuk) but maybe this is the greatest strategy possible in chess and what stockfish has done so far is to just calculate by brute force without any strategy
Exactly, A0 combines the best human strategies + perfect calculation of the best engines + it's own unique insights.
Deep mind also uses brute force.....
@@paultan5419 yes but it does immobilize the enemies pieces which is very advanced
@@firstnamelastname7298 The AI has no idea what chess is or strategy it's using. It's merely a naive algorithm using a trained machine learning technoque to evaluate all the possible states (with pruning) and pick the best move. It has no idea what chess is, or any concept of what it's doing at all.
@@firstnamelastname7298 my point is that whatever techniques it uses, no matter how advanced, it's still brute force (from a computer science perspective )
Stockfish = Usain Bolt
AlphaZero = Jet Engine
No no no! It is Jiren vs Goku!
Stockfish = hamster
AlphaZero = Lamborghini
It's more like:
Whoever the best human chess player is: Usain Bolt
Stockfish: Ferrari
Deepmind a0: F-22
What this game shows me, is that human opening theory is too conservative. Deep Mind used its knight aggressively and early, to tie Stockfish in knots and achieve a decisive advantage. Of course, you have got to be be damn strong to get away with this!
Learning It Quietly well also humans wouldn’t play the way stockfish would IN REACTION to Deep Mind’s moves.
The problem is that some of the lines these engines may play are so risky that if you aren't 100% of accurate you will blunder the whole game and even the greatest GMs will struggle to find those moves every time.
Can we have more Deep Mind games please?
Too weak, too slow.
Like shooting stockfish in a barrel.
this is gold
@@duckgoduckgo this is finegold
Agad, all I gotta say is, when you reach 100k, 200k, 300k, and so on, don't ever change the way you operate this channel! You're simply the best TH-camr I've ever watched, since TH-cam started in 2006 or whatever. It's okay to tweak things here and there to try new approaches, but the very basic premise of your channel is hands down the best on the internet. Thank you for bringing so much joy and laughs to my life man! I been subbed to you since 5k, from an old channel I used.
+BayToTheVeg Thank you for such wonderful words. I'm not planning on changing it, maybe I'll fit in a vlog here and there :)
I agree!
Which is fair enough since we all don't (want to) pay for this content!!
More like one of the worst chess channels. I guess beginners like this kind of rambling without any explanations
Buranazi that's not very nice! If it annoys you so much, don't watch or comment silly :)
agad you said stockfish was rated around 2400 in the beginning of the video, isnt it 3400?
Yes, it is :) I meant 3400 :)
Looking at the way game went ... we so understand why you said 2400. Scary! 😳
Hello agadmetor,nice video. By the way can chess openings be mastered without knowing theory? If no, what about chess 960 ? All that is required is creativity.
agadmator's Chess Channel ya right..because when ever i make stockfish and magnus carlsen app play....stockfish crush him...so it can't be 2400
The gams lasted for 7 seconds
Very moving. NEVER thought I'd see something hand stockfish such a profound loss. Damn! What can I say.
When I play against strong Engines my Position always looks likes Stockfishs in this game. Scary
Deep Mind is the name of the Google company that developed the software, AlphaZero is the name of the program.
In the middle of watching this game and I just want to say, in reference to your survey earlier, this is the length of video I am most content with on this channel - you give enough information on each move and it's direct implications, and you should keep up the great work. Now back to watching, and I'm thoroughly enjoying this game so far
Look at how Deep Mind and Stockfish only push the minimum number of pawns necessary... This is very interesting and educational
Arya once you push a pawn, you cant un-push it.
Alan M. In human play you can see pawns marching forward in order to anticipate a good piece placement or to protect a well-placed piece. But Deep Mind just tossed his pieces in the enemy's camp with little to no support.
Not only in the enemy camp, he puts his pieces straight under attack. I mean, I tend not to put my bishops in the diagonal of a pawn.
I love pushing pawns. I think I gain tempo and space. Usually they get too far ahead and cannot be protected. Divides the army. Checks with no purpose.
I watch these games and sometimes zone out for a second or two, then I get taken back by stockfish somehow being in even deeper trouble than just some 4 moves earlier. I continually have to pause the video and go back to look how it happened.
There are some very seamless transitions from position to position and stockfish is fumbling in the dark. This is incredible.
it is still worth watching even after almost 2 years , thanks for sharing the most beautiful end game in the history of chess
Wow. Deep Mind *obliterated* Stockfish. I have never seen Stockfish get so utterly *demolished*. Unreal.
Nathan Xaxson o
th-cam.com/video/sDlyTucx95k/w-d-xo.html this fellow found some discrepancies in stockfishes choices...
There was probably a mistake regarding the ratings; I think stockfish is 3300+ and not 2300+ :)
+mike s. Yes, I meant 3300 :)
Also, they played 100 games of which Deep Mind won 28 games and 72 draws were made. The supercomputer they used to train it takes 4 hours, but that would take around 70+ years on a regular PC, so the question is, when will it be as light as other engines out there, and when can it be used for training humans?
Amazing. Just a note of the variation shown where Stockfish didn't capture on g5 - actually Stockfish considers it a very bad position for black to capture, and the reason is clear -
The variation you gave contains a small error - instead of the incorrect hxg7 in the middle of the variation (which indeed leads to a balanced position according to Stockfish), just Qd4 leads to a winning position for white.
Amazing game :) Thanks for posting
I know you probably don't want to do 2 games from this set, but example game 9 is a crazy game that I would love to see you review.
1. d4 e6 2. e4 d5 3. Nc3 Nf6 4. e5 Nfd7 5. f4 c5 6. Nf3 cxd4 7. Nb5 Bb4+ 8. Bd2 Bc5 9. b4 Be7 10.Nbxd4 Nc6 11. c3 a5 12. b5 Nxd4 13. cxd4 Nb6 14. a4 Nc4 15. Bd3 Nxd2 16. Kxd2 Bd7 17. Ke3 b618. g4 h5 19. Qg1 hxg4 20. Qxg4 Bf8 21. h4 Qe7 22. Rhc1 g6 23. Rc2 Kd8 24. Rac1 Qe8 25. Rc7 Rc826. Rxc8+ Bxc8 27. Rc6 Bb7 28. Rc2 Kd7 29. Ng5 Be7 30. Bxg6 Bxg5 31. Qxg5 fxg6 32. f5 Rg8 33.Qh6 Qf7 34. f6 Kd8 35. Kd2 Kd7 36. Rc1 Kd8 37. Qe3 Qf8 38. Qc3 Qb4 39. Qxb4 axb4 40. Rg1 b341. Kc3 Bc8 42. Kxb3 Bd7 43. Kb4 Be8 44. Ra1 Kc7 45. a5 Bd7 46. axb6+ Kxb6 47. Ra6+ Kb7 48.Kc5 Rd8 49. Ra2 Rc8+ 50. Kd6 Be8 51. Ke7 g5 52. hxg5 1-0
+CubesAndPi I will probably do 1 more, checking all of them now
3 wins, 47 draws with Stockfish on white. 25 wins, 25 draws with AlphaZero on white.
Démian Janssen that's crazy
Oy that bishop sac...
@@iNeedPhone That shows how strong the starting position actually is for godly players. 😂
Stockfish: "Your move, D."
Deep Mind:
3:48 "I mean . . . this is Stockfish." lol
and deep mind plays french defence....agamator sheds a tear
Lmao
Sends "sometimes to win a war, sacrifices must be made" to a whole new level. 2 pawns for 2 pieces that are not in play.
6:33 Deepmind to Stockfish: "Look at me! I'm the boss now."
I love how you self-censored at 2:14 lol ;)
blamtasticful. I missed that 😂😂
2:11 deepmind makes stockfish look like a little...
U wanted to say Bitch haha😂 I feel you it pronounces smoothly.
+Robb V. Of course not :D
I thought he was about to say a little boy but changed it to kid. I don't think it is that common to use slang such as "little bitch" if you're not from the states.
Victor Udd-Peterson i aint from the states
Hi agadmator, in the article you shared with us there are 10 games played between these two AI. The article is really good and I recommend people to read it
Great that you posted the arxiv article! Very professional of you, thanks :)
I'd be interested in seeing some of the self-play games that occurred near the end of A0's training. How do you beat something like A0? Only A0 knows.
Thanks for making this game available, it is the first I
heard of it.
It appears that 100 games were played between Stockfish 8
(S8) and the Google entry, AlphaZero or DeepMind (DM). It seems we are
comparing apples/oranges in terms of the hardware on which the games were
played. DM was played using 4 TPUs (Tensor Processing Units which are little
super-computers that do specialized work). S8 was said to run using 64 threads
(does this imply CPUs?), and 1G of hash. S8 isn’t the most recent version, and it
also plays endgames better when it has Syzygy endgame tablebases available. The
paper doesn’t mention this. It does say that S8 was searching at 70 million
positions per second, which is about right if 64 CPU’s are available.
DM searches 80 thousand (that’s right) positions a second
and according to the paper, is highly selective in its search. This has been
the holy grail of chess engines since they were first conceived. Humans don’t
look at every possible move, but how do you design software to think like
humans. S8 and other modern beyond-human (they use superhuman way too much in
the paper) engines do it by pruning the hell out of the search tree. All
captures and some checks are examined, but after that, only a few “quiet” moves
qualify for examination. This is how S8 can search so far ahead in a short
amount of time.
We also don't know either side had an opening book, though I’m
guessing no.
I agree with your Tal comparison. DM does appear to always be looking for the
series of attacking moves. Very aggressive. But here we must consider a couple
of things. Tactical move sequences, where both sides are trading pieces can only
be resolved by tree searches using current state of the art engines. Has the AI
of DM found a better way? After all, it is only searching 80K positions/second.
Is this enough speed to resolve deep combinations? They paper doesn’t describe
what goes on in their searching, but we know from experience that most chess
games are won/loss by the balance of material.
This is especially true at the early stages of the game, where if you
are down a minor piece, it is a tough battle to catch up. Searching a tree and
only considering the captures can be fast, since the problem self-reduces by
the nature of removing a piece from the board with each capture. The paper
doesn’t indicate how “deep” their search is.
I’m sure more will come out of this as more papers are
published.
The claim was made that DM was only given the rules of the
game, which I assume means it was not given information about the merit of
various elements, such as is having a Bishop pair vs a Knight pair is good or
bad, but it might have been told to consider that feature in its learning.
This is how chess engine evaluations work. they measure many
"features" of a position and then come up with a number that
represents how good/bad the position is. Regression analysis is usually used to
combine many features. Again, not sure how Google did it with DM, but I’m curious.
Their algorithms must measure something, so what are their features?
AI techniques have been around for some time, and there is nothing new about
self-learning chess engines.
I would take some claims, such as it only was taught the rules of chess, with a
grain of salt until we know more about what the neural network is measuring.
Show me the details!
Back to the game and the pivotal moment.
21. Bg5
WOW! I agree, where did this come from? I let SF chew on this for 90min looking at the top 5 moves and it got up to 41 plies (20 moves by each side) and found Bg5 as the best move. SF is only searching 1.3 million positions/second on my slow laptop, but according to the paper, each side was only given 1 min per move. So, based on some simple math, SF should have found Bg5 in 90 min on my laptop if the move was that
decisive. I then had SF search the top 5 moves...
So what this really means is, DM found a 20 move ahead move and SF8 agrees.
well beyond what we mere humans can figure out!
You ask what DM’s rating is? Based on the paper, it is just slightly better than SF8 at 3300-3400.
They played 100 games, with each side playing white and
black equally. DM won 25 games as white and rest were draws. DM won 3 games as black, the rest were draws.
DM did not lose a game.
Amazing….
Alan Kilgore I don't think DM was given any openings, and I don't think they are that close if DM never lost once in a hundred games but won many games, with the rest ties. I could be wrong about the opening books though
The way AlphaGo was developed, I completely trust that DeepMind was given nothing but the rules. It is amazing what trial and error can achieve without anything to prejudice your perspective on how a game ought to be played.
lsduuhyik ygytyuui
1i thought they just played 100 games.
There are videos on how deepmind works, or how the newest one which uses reinforcement works. Reinforcement learning basically means it plays against itself over and over again, recognizing new patterns over and over again that lead to a win more often. It starts just playing randomly at first, and recognizes patterns that lead to winning( like castleing). The thing that is amazing about this is that there is no human involvement whatsoever. It has learned from complete scratch, and has deduced the best possible lines and theories and ways to play the game in 4 HOURS. This is also kind of sad as well. If you run deepmind longer, it will eventually get to a point where it is playing chess the best way it can possibly be played. If they do that, chess will literally be complete, in my opinion. There will be no further discussions about what the best move is in a position. Sure, you don’t have to play that move, but the fact that you know it is the best is kind of sad to me.
Grayson Parker this is an assumption.
Perhaps let it play against itself even longer and it will realize that last move previously thought best was actually not.
Even though it was only 4 hours, do you know how many thousands or millions of games it went through?
I want to thank you dear Antonio for such a delightful channel - you’re doing it so vividly and interesting .. p.s. I laughed so many times from your comments on some moves and tactics .. keep up the good work !
I saw in someone else’s comment you said you might throw in vlogs at some point. I think that would be cool. Congrats on your channels success. Definitely my favorite chess channel!
117 moves, unbelievable
This is so beautiful! Stockfish plays like a engine BUT Deep Mind plays like a Human who is 10 times stronger than the strongest human! Crazy and also shows the scarry future of AI's
I love how chess is such an interesting measure for these things
This are the things that I love to hear about science and technology. Just incredible!
Dude...you are the top youtuber on this particular AI subject!!!
Just setup your channel on ROKU. AWSOME!!!!
Cool. Let me know how it works :)
AMAZING! I was studying Reinforcement Learning, (which is the same framework from which Deep Mind's AI was trained) when I saw this video. At the end I just got back the enthusiasm I was loosing for the lack of sleep. Amazing time to be alive! Reinforcement Learning/ Machine Learning / Deep Learning is starting to make a great technological revolution. What a time to be alive!
Symphony. This game is so beautiful that it has the same effect of a masterfully composed symphony which leaves it's audience speechless. I am deeply moved by this game.
What do you need to win a chess match?
Alpha Zero: 3 pawns ad a knight.
Someone has gotta say it: Skynet!
I can't even describe how amazed I am; I mean, self-teaching for 4 hours and it destroys the strongest engine? o_O Thanks for this mister!
it is maybe the best ending game in the history of chess but this is indeed the best commentary about alpha zero in the whole Universe , thanks I think I watched this tenth times and it is still magnificent and has a lot of magic into it. and I also have an idea and I am going to do the exact moves against stockfish 8 and see what will happen :)
This is frightening.
Me looking at the thumbnail: THATS CALLED THE WOODEN SHIELD
re the slow conversion: another thing to consider is that alphazero works by optimizing the winning probability (unlike stockfish which optimizes the evaluation in centipawns), so it happily chooses a slower conversion if this means that it's more sure to win. Also in the Go version, conversions were often strange to the human eye
Seems the best way to play is to accurately sacrifice your pawns for a positional advantage.
I must be the only one here who doesn't know anything about chess other than how the pieces move lol
To me, the guy reciting the letter and number coordinates immediately after a piece moves was unreal XD
It's amazing but here is a comment of a machine learning expert (Pedro Domingos): "AlphaGo Zero is great, but hold on: self-play is one of the oldest ideas in ML, and humans take far less than 5 million games to master Go."
Here is a comment from a machine learning guy who is probably not as much of an expert as this guy you're talking about: AlphaGo Zero is so much stronger than any human could ever hope to be. If that's what it takes to "master Go", then it would take a human infinitely more games to master Go, because a human would never reach that level.
Yeah, but it is also a few thousand times better than any human who has mastered Go.
you can't possibly master go.
I think it's very important to keep in mind how difficult it is for a software to play Go on a professional level. They only achieved that last year with alpha go (was it last year or two years ago?) before that there was no engine that could beat a top level go player not even the lower ranks of professionals. Agadmator brushes over this a bit but I don't blame him, most chess players don't know anything about Go.
Hi Agad I really love your vids great analyzation more power :D
Damn, you're quick!
Skipped watching your stuff for 3 days (busy). I get linked to the paper on arxiv. I check your channel: already the case :o
I am working on my masters in mechine learning and I can tell you we are very far from skynet level ai. We are talking like probably not even my life time kind of time. Then again technology is growing at exponential rate so we will see.
Wow..what a match...im very happy to see stockfish lossing a game as i play against it and he crush me like hell ..so it feels nice....😉
Hey agadmator when i saw that game of bobby fisher in which he player evans gambit(if i wrote it right) from that day im in love with that Openning...but as usual i can't play it that good...so can you show us a video fully analysing that openning or can you tell me a book to refer for mastering in it..??
I was hoping for Stockfish to win. So were most of the chess programmers who have spent some considerable time of their lives learning and developing conventional algorithms. It was a bit sad to see some AI from Google come out of nowhere and defeat the strongest chess engine. But we have to accept it, move on, and learn new methods. Although it's too early to conclude anything. More testing must be made: different hardware, different time controls, etc. Stockfish did not have an opening book! It's important. And also, I don't see many people mention that most of the games were DRAWN. Agadmator gives the impression that Stockfish lost all of the games. It's misleading.
pahom, so you are a programmer and you claim that Alpha0 is not AI? How is it not AI then? I'm genuinely curious. Because to me it totally seems like AI implementing unsupervised learning. I'm not familiar with details of Alpha0's implementation but we can all agree that the core of it is machine learning which is a field of AI. And even if the gathered data is then interpreted as evaluation it doesn't really matter, that's not the point.
pahom, I see, so you're a smart-ass. Good to know. Many competent developers worldwide use the term AI and they're completely fine with it. I'm not pretending to be an expert here: AI is not my field. But this doesn't suddenly make me not a programmer. I work with .NET platform, if you're curious. You can go and convince someone else in your superior intelligence. I'm not interested.
pahom so you are saying that they are misleading us............ and how you know all this???
pahom AI stands for Artificial Intelligence. This term means a program that can teach itself to do something really good from a basic level without human input. Think about it as you would about a human mind: you teach your child, say, the basic chess rules, and after that you give him a chess set and tell him he has some time to play against himself and improve. This is what they mean by "intelligence". If it's "artificial", them it's a human made program that can teach itself. Google's Alfa Zero can teach itself to play chess, just like a human with real intelligence can, only way faster (like 1000 times faster). It also has more computing power for complex calculations of course, just like humans have a brain for that. That's why Alpha Zero is indeed an AI. It is not the final step of AI development by any means of course, but denying it is an AI is strange, as you know that it managed to teach itself, so what is the problem? If you were expecting AIs to be able to teach themselves to play chess without any inputs like basic chess rules, then your expectations may need to be altered, as no real world entity can operate with magic.
That end game reminded me of the scene in The Matrix when Neo is blocking Smiths punches with one hand.
Mr. Anderson
Great Video as always! Very Interesting game :oo
2:10 “Deep Mind makes Stockfish look like a little b- uhhh kid”
We all know what you wanted to say...
Not a word about go, agmator. I am disappointed. But your surprised reactions are just like the ones in the go community, when they were confronted with AlphaGo: "This is beauty! Wow."
+Ger Hanssen I never tried GO. Don't think I would contribute much. Is there a good online server to tryout go? I am planning to learn the basics some time soon and maybe do a short video on it
Ah, that would be interesting. I am willing to help in one way or another. What I wanted to say is that this whole development of AlphaZero came out of the challenge to play go, and that would have been worth mentioning.
I don't play online go very much. Pros nowadays prefer Tygem (www.tygembaduk.com/ehowto/tygemgo.asp), but there are at least 10 other ones, some of them 100% Asian. I know that from the videos of Haylee (th-cam.com/video/VBv7XpiEY44/w-d-xo.html). She is a top pro that played as a strong amateur commenting during the game while thinking. She picked the idea up from a chess player. She never mentioned who.
Sensei's library (senseis.xmp.net/?About) tells you just about anything about go and the go community.
Agadmator you analysis has really really emproved the longer you have done this
Nice touch with the Roku!!! Will subscribe :D
I've recently seen an AI similar to this called OpenAI. It learns exactly like you've described Deep Mind - by continuously playing against itself given only a rule set. Now, OpenAI has been used in Dota2, a computer game, so it's quite different in that regard, but still very similar. And yeah, it usually beats the professional players very easily. In the case of Dota2 and many other video games, the games themselves are too complex to make a successful equivalent of Stockfish, but this new method seems very potent.
If people tell the program what to do, it will only make "people-moves" so to say. If it learns by itself, however, it will make up new things, and people can in turn learn new ways of playing and exploiting things in the games from the AI.
Very exciting to me! :)
Ehm, Deep Mind developers? Hi. Just wanna say... if you see a woman with a shotgun, a very big man and a child, just run.
Hasta la vista, baby.
HahahHa
Very impressive game, great video!
I so much love these games by alphazero.
3:47 stockfish? More like stuckfish
I played a move AlphaZero played, 1.d4
Hey agadmator plz make more deep mind videos
More deep mind games please
These two players need to study more openings
For example, at 3:02, why didn't white take the dark square black bishop?
Floyd Maxwell that would just give up a powerful knight and allow black to develop their queen
Aren't bishops worth more than knights, and the dark square bishop the more valuable of the two?
Mate, they are beyond studying petty human openings
human opening cant even compare to these, it's on another level
I can mate deep mind from this end position in 11 1/2 moves...😠
deep mind wanted to humiliate stockfish by taking all the pawns first and then having it give up
Love your vids.
do more deep mind games :)
sometimes I wonder why spend years learning about a game that an algorithm can master in just 4 hours?
Because, in the end, it's still the humans who have the creativity to do those things, it was human intelligence that created AI, even though AI is vaaaaaastly superior in speed processing and effeciency, we still have creativity and a lot to be expected from :D
“I often sacrifice a pawn”
Deepmind: “Singular or multiple?”
“What”
“What”
Love your channel so simple
I think one comment you made is extremely insightful, and it is something I thought as I was looking at the endgame: when a strong human player is up the exchange in the endgame, it doesn't take long to finish matters off; and this is due to a collection of inaccuracies by your opponent. What this endgame shows is how much technical prowess is required in an endgame when no glaring inaccuracies are being made. Study the endgame, folks.
Nah deep mind would lose to beth’s queen gambit
'This could be the greatest end game ever played in the history of chess!' - you nailed it with that line.
Everyone. Mark this day. A paradigm shift in the application of AI in chess (and beyond)....
It would be interesting to see if they have a difference in evaluation throughout the game
This just highlights the amazingness of a fact that human actually managed to pull a victory against Deep Mind in Go.
Go is just so much more intangible and complex than Chess is..yet so much simpler at its core.
A true Beautiful Game.
When I play stockfish, 30 moves in
My pieces: my time has come
I don't know if it is just me being a paranoid person, but This Alpha Zero has got me pretty worried, tbh
Alpha Zero took in to consideration run the world but at the end it seems prety point less for him, you know he calcula tes very far away and well at the end It's not interested
Such a brilliant endgame! I wish I could play like that
Given that neural networks can be trained and theoretically produce different results, unlike traditional chess engines which are purely computational and bounded by the information fed to them, I wonder if we could identify some distinct "styles" that emerge from many iterations of Deep Mind. What if we trained 10,000 of these and found one which was more "tactical" and one which was "positional"? What if they played each other?
What would happen if we fed the rules of the game into Deep Mind, but started with a set position? GMs are already pretty adept at arriving a set position 15-20 moves into a game, so having the best chess "entity" in the world play out moves from one of those set positions as a next level of preparation does not seem too far off in the future.
The key aspect here is the 1 minute / move time control, as due to neural networks and search algorithms AlphaZero is far superior to Stockfish: 80k vs 70k evaluation speed (positions/second) in favor of AlphaZero! It would be interesting to see a 100 games match in standard time controls between these two... I would bet then the evaluation speed won't count as much and the result would be way more close than today!!! :)
According to the paper, AlphaZero evaluates 80 thousand positions per second, while Stockfish evaluates 70 million per second, so in fact AlphaZero is vastly superior in terms of efficiency in the number of positions evaluated. However, each of those evaluations comes at a much higher computational cost.
In some of the papers I have read, they have stated that the time control arguably places a greater handicap on alpha zero and that stockfish is stronger on quicker time controls
Neural network evaluating is really slow compared to the evaluation function of Stockfish. The 70k you mention is actually 70 million, but it's always nice to try and confuse people by pretending you know something when you really know nothing
The next Chess engine to come out will play e4 and you lose instantly.
wow that was an amazing game from deep mind....just imagine after another decade of AI development !!!
2:14 "dont wanna get demonetized, gotta come up with another word" ahaha