AI Leela Chess Zero breaks Stockfish | TCEC Season 14 Superfinal - 2019
ฝัง
- เผยแพร่เมื่อ 13 ก.พ. 2019
- This is a round 11 game between AI Leela Chess Zero v20.2-32930 and Stockfish 190203. It was from the Season 14 Superfinal of the Top Chess Engine Championship 2019. Both Leela Chess Zero and Stockfish earned their way to this final 100 game match. The featured game demonstrates how exactly Leela earns that first full point. The opening played, French Defense: Tarrasch, Guimard variation with its early fixed pawn center, is in my opinion ideal for the neural network.
Specifications:
Current TCEC server
CPUs: 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz
Cores: 44 physical
Motherboard: Supermicro X10DRL-i
RAM: 64 GB DDR4 ECC
SSD: Crucial CT250M500 240 GB
Chassis: Supermicro
OS: Windows Server 2012 R2
GPU Server
GPUs: 1 x 2080 ti + 1 x 2080
CPU: Quad Core i5 2600k
RAM: 16GB DDR3-2133
SSD:Samsung 840 Pro 256gb
PGN:
1. e4 e6 2. d4 d5 3. Nd2 Nc6 4. Ngf3 Nf6 5. e5 Nd7 6. Nb3 b6 7. c3 Ne7 8. h4 c5 9. h5 h6 10. Nh4 c4 11. Nd2 b5 12. Qg4 a5 13. Be2 a4 14. a3 Nb8 15. f4 Nbc6 16. Nf1 Na5 17. Be3 Nb3 18. Rd1 Kd7 19. Bf2 Kc7 20. Ne3 Kb7 21. Qh3 g5 22. hxg6 fxg6 23. g4 Ka6 24. Nhg2 Rg8 25. Bf3 Ka5 26. Bh4 g5 27. Bg3 gxf4 28. Nxf4 Ra7 29. Bh4 Bd7 30. O-O Qe8 31. Rf2 h5 32. g5 Ng6 33. Nxg6 Qxg6 34. Bg2 Qe8 35. Rf6 Bc8 36. Qg3 Rc7 37. Bh3 Bg7 38. Kh2 Rf7 39. Ng2 Ka6 40. Qe3 Ka7 41. Nf4 Re7 42. Rg1 Kb8 43. g6 Rh8 44. Rg2 Ka7 45. Qf2 Rb7 46. Bxe6 Bxf6 47. Bxf6 Bxe6 48. Bxh8 Bg8 49. Bf6 Nc1 50. Qe3 Nd3 51. Nxd3 cxd3 52. Qxd3 Rb8 53. Kg3 Be6 54. Kh4 Kb7 55. g7 Qd7 56. Rg5 Rc8 57. Rg1 Bf7 58. Qf3 Qe8 59. Rf1 Rc7 60. Qd3 Bg8 61. Kg5 b4 62. axb4 Rc4 63. Kh6 Qe6 64. Qf5 Qe8 65. Rf3 Rc6 66. Qxh5 Bf7 67. Qf5 Be6 68. Qg6 Bf7 69. Qd3 Re6 70. Kg5 Qc6 71. Rg3 Re8 72. Rh3 Rg8 73. Rh4 Qd7 74. Kf4 Be6 75. Rh7 Kb6 76. Rh6 Kb7
Software used in video:
Blitzin via www.chessclub.com
I'm a self-taught National Master in chess out of Pennsylvania, USA who was introduced to the game by my father in 1988 at the age of 8. The purpose of this channel is to share my knowledge of chess to help others improve their game. I enjoy continuing to improve my understanding of this great game, albeit slowly. Consider subscribing here on TH-cam for frequent content, and/or connecting via any or all of the below social medias. Your support is greatly appreciated. Take care, bye. :D
★ LIVESTREAM / chessnetwork
★ TWITTER / chessnetwork
★ FACEBOOK / chessnetwork
★ PATREON / chessnetwork
★ DONATE www.paypal.com/cgi-bin/webscr...
Nobody does a high quality instructional walk-thru analysis like Jerry.
Maybe Daniel King?
If he's only body, where're his fingers?
@@NoNameAtAll2 haha, tragic
@@NoNameAtAll2 😂😂😂😂🤣if you have no name, what should we call you?
So long as you speed it up to 1.5x
Uploaded on Valentines day, a love letter from Leela
an outstanding move from Jerry
This game reminds me of when Kasparov led Deep Blue to a very closed position and completely dominated with his ability to play strategically to win the match and the tournament. At the time, it was telling of how computers were limited creatively in closed positions and Kasparov took advantage of that. Except in this game, AI Leela plays in the role of Kasparov and teaches the same lesson to Stockfish!
Alex Cutrim Great observation!
History repeats it self huh
Stockfish 11 would disagree now
It's a flaw in the code where the engine wants to push for a win because it has a material advantage even in a completely drawn position. That's why self taught neutral networks won't have this problem because they don't assign value to pieces.
Leela and AlphaZero agree: When the center is closed, H4 is your move.
They grow up so fast...
well leela has played centuries of chess
yeah and before you can look back the nn starts a nuclear clean-off of earth =b
So awesome to see Leela have such success! Thanks for the vid
always nice to see leela videos from such popular youtubers, great video
"I benefit from it and I want you to benefit from it" only Jerry can say it.
No. Anyone who's not a complete psycho can say it.
Alexandru Popescu can you say it Alex?
ive already seen this game and I knew so from the thumbnail but because its a video by you I chose to watch it again :D, 100% worth it, great video, keep up!
I love your videos. They teach and taught me so much. And they got me really interested in Chess again.
I realised how much I've missed videos like this from you. Agadmator is good but your style of explaining what goes on in the game is simply outstanding!
I find the two of them outstanding in completely different ways. Agadmator has a passion for the history and theatrics of Chess augmented by a loveable bro-lets-go-grab-a-beer charisma. Jerry's passion, I feel, is for the beauty of the game itself. The strategies, nuances, and subtle imbalances of Chess seem like a lifelong educational journey; a private journey which luckily he's willing to embark upon publicly. With all due respect to the top players, in my opinion, few people--if any--have done more for the game of Chess in the last few years than Agadmator and ChessNetwork.
Thanks Jerry!! Love your content!
Thank you for the video! All of you friends are super awesome!
Excellent video and instructive analysis.
Wonderful analysis!
Aw, no post-game smack talk from Leela to Stockfish in this one.
Nh4 has one additional purpose Jerry didn't mention. In the Guimard line, black often plays f6 to break open white's centre, permitting a weakness on e6 but getting good piece play. Now, f6 would allow Ng6, pretty much forcing a knight trade, after which white would have a monster fawn pawn on g6.
Nice additional point!
👏👏
That was awesome man, thanks Jerry :)
This is sick... beautiful game, total domination from the very beginning.
What a time to be alive.
Thanks Jerry. We missed your insightful and instructional videos. How about some more analysis of Alpha Zero games now that more games are released to the public?
We have seen the best of them. Doubt there is anything worthwhile left. Probably a lot of draws with already seen concepts. And ofcourse Deep Mind has long moved on from chess.
The way you see and analyze these games is way beyond a grand-master can see. #LoveYourVideos
That one dislike is from Stockfish.
Phenomenal analysis
Thanks for covering TCEC games! - careless25
Wow. Absolute domination by Leela. She certainly has a definite edge when it comes to closed, strategic positions.
Hi Jerry, move 38 which black moved the rook was also for saving it from queen capture with a check.
I'm by no means good at this game but could the move at 3:30 also be a way of defending the queenside through gaining influence and mobility on c6 (and by extension, b5 and a4), taking away some of the light-squared bishop's more aggressive moves?
awesome vid bro
It was awesome seeing the white bishop and rook bail and escape while the knight was heading in only to find empty barracks.
Expending all that structural effort to get the knight on b3 seems like a pretty typical heuristic-based mistake. If your evaluation heuristic says that a support knight forward in the enemy camp that cannot be attacked is good, then the engine will prefer this sort of position even though in this case it makes no sense and essentially kills the piece. That useless knight seems very "computer-like" to me, and the way Leela ignores it seems like what you might expect from a human player. Stockfish was just painting by numbers with that piece :)
Leela actually didn't 100% ignore it. The knight would've been a monster if it was allowed to go from d2 to e4, so Leela always made sure that a piece guards d2. A rook was always guarding d2, so it wasn't really a bad trade for Stockfish -- an inactive knight vs an inactive rook.
@@DraoxxMusic Another decent threat was c1->d3. Leela guarded against this later in the game with her knight on f4, which allowed the rook to leave the first rank. The number of squares available for that knight to escape was few enough that it was always possible to guard them while also making use of the guarding piece for other purposes. So, the guard pieces were doing something while the black knight was doing nothing but sitting there. Note that on g2 the rook was doing quite a lot while still guarding d2.
Lets say, Leela "Alpha Zero'd" that knight.
@@IschmarVI Yeah, it reminds me a lot of the games where A0 traps an opponent bishop behind an immovable pawn wall and basically takes it out of the game :)
@@DraoxxMusic Not only that, but a whole structure supporting the knight and the startegy, that didn't do that much else
Whenever Jerry upload's a video, first I go make a peanut butter and Jerry sandwich and then watch the video 😋
Talking about the e6 pawn, there are lots of scenarios where I like to make an early exchange with a Knight, so maybe sending him to h4 with hopes of f6?
Thanks Jerry :) Sad to see Stockfish is beaten so easily.
Easily??
Seriously? 😕
2 GAMES AHEAD BOIS!!
Hey Jerry, it's everyone.
its full of stars (:
I have seen several games like this with one closed side, and every time Leela (or AlphaZero) just led Stockfish into playing random waiting moves or zugzwang and destroyed it. Crazy!
Jerry you are awesome cuz you explain it so well
Feedback:we need more videos!!!!
History in the making.
I don’t know how to describe it, but this game was just so... cool
I miss AlphaZero's words of wisdom. Good video. ^^
Beautiful
Have you seen game 49? its an AI train running over Stockfish !!
I'm a big Stockfish fan and, for me, LC was a promise, but Alpha Beta engines (say brute force) will prevail. Seems I'm wrong. And LC plays very nice.
When you think about the branching factor in chess a standard a/b is getting less return on it's calculating time the deeper it goes. The smarter approach of neural nets will eventually overtake the a/b engines.
19:31 there is still a checking resource for white: instead of Q-c7+, do Q-d6+ after the double capture on f6
Good to hear your voice jerry
Thank you Jerry.
Am I missing something when I suggest a move like 18... Ned6? A second attacker on white's d-pawn (well defended, but still) and preps a move like ...b4 (which is now supported by bishop and knight) to break the queenside and get a deep passer. Obvious glaring issue is king safety, but the on-board game felt too passive!
Stockfish won the 100 games competition with 50.5 to 49.5. Good job Stockfish... I guess.
i like your mentioning of the opening variation in the video, thats a huge improvements. however you should go deeper in your explanation and articulation. good job as always, anyway
Why have pre-set positions for stockfish and leela instead of letting them play on their own from move 1?
12:15 did the black pawn go to g5 or g6? because you show the white pawn making an illegal capture move there
En passant
A quick question if I may:
At 19:35 you said that there would be no way for the white Queen to place a check on the King after he has moved to a6 (move 39). But she could have used the 6th file for a horizontal check on d6, no? D6 being unprotected, I find it almost nicer of a spot, looking at the black d/e pawns.
This doesn't really matter for the game as a whole, since it developed otherwise, but I was just wondering if there is a problem with that strategy.
The Queen can't phase through her own pawns.
Leela maneuvered a positional advantage quite early in this one.
My best Valentine gift is this video
I love how the first time stockfish moves a piece besides their king or their knights (which were moved before the start of the game) was on move 24. Opening principles? Never heard of him.
I like these videos about learning to play chess, its inspiring , i just got my channel playing chess against computer, relaxing and entertaining
More vídeos like this please
So you… at 13:02... would recapture the pawn on f4 and then be closer to advancing that pawn to f5? Yeah sure I gotta try that out at home sometime
JK, great video as always! Really instructive popquizzes!
On move 17 would Ne4 not be a better move than Nb3? I feel like that is a better square for the knight.
I guess white could play Bf3 and if black doesn't move the knight white can capture to force the pawn recapture. I think white would be better from that position but I'm not sure.
I have a question. Is it an i5 2500K or an i7 2600K in the CPU server?
Moving the a and h pawns seems to be favored by Alpha Chess Zero. Is Leela also leaning towards that? Does that mean that they are a resource that was kind of ignored by human players all this time?
I initially thought that black knight on B3 was black's best piece, until you pointed out how it could actually be the worse. Seems like something stockfish did because it knows that a knight on a forward outpost is generally good, and didn't really consider the fact that action was taking place on the king side, and that no coordinated attacks could happen due to the locked down position. It seemed like stockfish wasted a lot of moves, especially compared to white. You could tell that the engine didn't have a plan of attack. It had plenty of time to set up an attack on the queen side, hoping to promote one of it's many advanced pawns.
What GUI do you use Jerry?
Thanks for showing the hardware specs at the opening! But i5 2600k isn't a cpu. It's probably an i7 2600k 4c/8t, so apparently, Leela doesn't care much about RAM and CPU speed. Interesting.
Right, Leela runs on the pair of 2080 graphics cards. This neural network that runs on the GPU is an entirely new class of engine completely unlike the brute force CPU-intensive Stockfish (and basically every strong engine that preceded Stockfish). Leela looks at orders of magnitude fewer variations when it ponders and still ends up with amazing games like this.
the CPU used by leela in TCEC is i5-3570k
Jerry: I have a favor to ask: Could you get the TCEC guys to give precise power usage numbers on the current TCEC server vs the GPU server? Not estimates, but: Connect a watt measuring device to the thing (e.g. the Kill-A-Watt device), and report how many watts are being used during peak load. In fact what would be really amazing would be a graph of power-draw vs time. I can't seem to get a straight answer by searching online (or asking elsewhere), and I think this is the most fair comparison for what is basically an apples to oranges comparison of different kinds of commodity hardware.
Power usage is a good metric but for it to be fair, both hardware needs to be around the same age. TCEC's CPU was made with technology from 3 years ago while Leela's GPUs are barely half a year old, so assuming newer tech is more efficient, the comparison may lean slightly towards Leela. There's been discussion for TCEC to sell the old server and rent a newer one but I'm not sure what came of it.
@@quag443 Let's also talk about SF 10 doing hundreds of times more nps than Leela. ;)
@@dannygjk NPS is a very poor metric to use considering 1 Leela node has over 3 orders of magnitude more instructions than a Stockfish node. It's a basic rule of nature that you can't expect a 50-megabyte Leela node to run as fast as a 30-kilobyte SF node. Anyway there are lots of different metrics out there. Some favor traditional engines and some favor neural networks. Cherry picking one of them without context is not particularly meaningful.
@@quag443 I know all that I was merely using that to make the point that there is no easy way to establish 'fair' conditions.
Dawn of a new era indeed! Sure didn't take long for neural network machine to win TCEC ..
One thought occurs to me ... the biggest thing here may not be the strength of this program but how quickly it became so strong, and the fact that the ‘algorithm’ used is flexible and adaptable to different domains. I suspect the techniques used to make Stockfish et. al. strong in the chess domain are not transferable to other domains whereas those used for Leela are. For analyzing such systems mot only should we compare their raw strengh but also some metric as to the ‘energy’ required for them to get to that strength, the time to do so, and their level of flexibility vis-a- vis other domains.
plz post some standard games, I mean those classical games that you play
Is this version Tarrasch refuted?
9:50 black's best piece is e7 knight diminishing f5 and f8 bishop keeping black's king-side from collapsing.
What about queen d6 after exf6@19:34
10:10 best piece is probably one of the pawns b5 is holding a couple spots and is rear support for the b3 knight. At the moment though the Knight attacks nothing and best use would be to sac itself to open up pawn chain on d4.any other move would just get piece taken 3 spots from a bishop is a bad placing most of the time
Pretty clear these players should both be banned for using an engine. Leela may seem impressive, but it's obvious computer assistance was involved.
Boooooooooooo
Have u lost it??😕
@@RanDomDyCon Humor.
gFry65 r/wooosh
Oh, those specs of the servers!
Stupendous! Leela plays REAL chess!!!
Where did Stockfish go wrong? Was it strategically wrong for black to shutdown the queen side? It seems like black would have been better to gambit a pawn on the queen side to get some counterplay and at least force white to regroup.
Yeah, according to Stockfish 10 it was wrong. After 13...a4 Leela has a 0.8 advantage and never falls below that from then on (she does fall below it on the initial graph, but rises back up at higher depths). It's hard to say if it was a losing move, but it looks like it definitely turned losing after Stockfish wasted so much time moving his king to a5 and not developing his pieces.
@@lmabacus404 But why did Sf Dev (stronger than SF 10) play it then? I don't understand.
Yeah, 13...a4 seems to close down the entire queenside and deprived SF from any counterplay. b4 might have been the better move. As to why some versions of SF were able to point it out, could be many possible factors. Different hardware, time, contempt settings, etc.
@@lmabacus404 It's very easy to say that Stockfish should've developed its pieces, but it was very hard to see where the positions of the bishops and rooks could've been improved in the early mid-game. Stockfish's "mistake" was strategic, not tactical. It chose to position the knight down the board thinking that it could provide play, but Leela just moved everything to the other side of the board making it irrelevant. It turns out that the knight was necessary to shut down advance king side, but it was always three moves away from being able to help out and thus too slow. There were no tactical mistakes, Stockfish was just outplayed strategically.
SF did strategic mistake since after out of book. In reverse game, Leela defended as draw. Go and check TCEC archive and learn yourself. And dont do anlaysis with SF, it will be misleading, cos the SF that play in here was already 44 cores, and stronger than your PC.
audio too soft. right click -> stats for nerds -> volume : -8.5dB. You'll want to amplify or normalize the audio in post processing so it is between 0 and -2 dB
audio is fine for me
totally agree with your assessment of the "far away" knight! looks good but doesn't do anything.
how quickly are these games played out in real time?
Various time controls are used it depends on the event.
Jehrrrry💪
Is there a reason why the black king gets to a5 by going c7, b7, a6, a5; instead of c7, b6, a5 and doing it in one move less?
maybe avoiding tactical shot that we -human- didn't even know.
or maybe sf just didn't know what to do in that bad position, so he just prolong the game as long as posible before resigning.
the return of Jerry
Is alpha zero not better than stock fish? 0_o
Ar 19:30 you can still move the queen with check to d6, no?
true. but i think its also a good idea to stay away from a pin, no?
Noobies!!
A. Aznadi
That’s an interesting find
whats jerrys elo
Did Stockfish resign or run out of time? Why did the game abruptly end?
I believe that if both engines agree one side is ahead by a large enough margin for some number of moves, they adjudicate the game as a win and move on to the next game. A modern engine isn't going to lose in an endgame if it's evaluating at +16 so it's just a waste of time to play it out.
What is this software/ site?
I thought you resign when it is your move and not your opponents? Why does it end with a black move?
Whose move it is doesn't matter you can resign at any time.
Look at how beautiful that knight is boys
Boys and girls, leela is getting strong.
Thanks jerry
I'm only a minute in and I hope this title wasn't as big a bait as "A Wounded Carlsen"... Jokes aside, I'm always here for some Jerry content.
19:27 check with Qd6 to take the rook?
I was checking the comments for this. I don't see what's wrong with Qd6. I think the king moving to a6 was just to allow the knight on b3 to return? I'm not sure
4am upload?
I mean...I’m okay with it
benefits of living in Europe: a regular Jerry upload hits at a normal time.
Okay, overlaps with work, but perfect for a lunch break
Reminds me of some Bobby Fischer games. That pawn diagonal is very strong.
Wow!
on move 40 ka6 black still cant double take on f6 because of qd6+
French Defense ?
18:19 "rook doesn't have to move" - why?
He explained it in the video: if bishop takes rook on F6 then the E pawn retakes, giving white connected passed pawns which is more valuable than the exchange.