Knowledge Distillation: A Good Teacher is Patient and Consistent

[@connor-shorten]

This paper was quickly previewed in the AI Weekly Update series!
Check it out here - th-cam.com/video/Y_htHk3snYo/w-d-xo.html

[@juanmanuelcirotorres6155]

You're the best one, I'm your bigger fan

[@connor-shorten]

Thank you, appreciate it!

[@irfanrahadi7487]

great video !

[@pawelkubik]

Fixed teacher caching was never very practical anyway, because it greatly complicates the pipelines and teacher inference time is usually dwarfed by student's backpropagation. Backward pass is waaaay more expensive than the forward pass.

[@NarkeEmpire]

You eat too many words... :(

[@patriciamachado6050]

I recommend you research no sulfates fast hair growth shampoo.