Wow. What a great talk. Substantial, yet easy to follow. And that seems to be a characteristic of papers he co-authored as well. Great research, but also great education. 🎉
Has someone more insight in what happens in the phase where the loss does not improve but it is still substantial to train on(i.e. have patience)? Seems to me there is still some significant weight reorganization taking place which not directly yields an improvement but sets the stage for the next lr phase
Your podcast has the potential to fill a very cool niche
Wow. What a great talk. Substantial, yet easy to follow. And that seems to be a characteristic of papers he co-authored as well. Great research, but also great education. 🎉
Nice talk and nice guy :)
Fabulous talk! Are these sides available to view or download?
Yes,it called screenshot
Has someone more insight in what happens in the phase where the loss does not improve but it is still substantial to train on(i.e. have patience)? Seems to me there is still some significant weight reorganization taking place which not directly yields an improvement but sets the stage for the next lr phase
Lower local minimum terrain that was flat where the deritives are closer to zero for a long time
the entire time I was worried if Lucas would get to where he needed to be on time
Lol
would love to read the slide, plz?
watch the video, literally :)
Screenshot