But What Are Transformers?

Transformers is arguably the most influential neural network architecture in the last decade, powering the current boom of generative AI.
In this video, we will review the basic ideas of the original encoder-decoder transformer architecture and understand how various design decisions are made.
Enjoy!

[@PimentelES]

Dude, your channel is extremely underrated. I am a physicist that likes to mix cs in it and is impressive how these methods are converging. LOVE YOUR WORK BRO

[@jbhuang0604]

Thank you! Glad you like them!

[@abdelrahmaneldesokey1762]

Out of all the Transformer tutorials out there, this video will be my future refernce.
Thank you for the great efforr!

[@jbhuang0604]

Awesome! Glad you like it!

[@marvin-schmitt]

Thank you for creating these fantastic videos.
It’s inspiring how you find intuitive explanations and powerful visualizations without sacrificing technical rigor. Please keep up the phenomenal work!
Greetings from a fellow ML scientist.

[@jbhuang0604]

Glad you like them! Thanks!

[@aikqboy]

Thank you for creating this channel! Your explanation is so clear and easy to understand!

[@jbhuang0604]

You're very welcome!

[@Steven-gy9gx]

This video is sooo good! Really appreciate your work!

[@jbhuang0604]

Thank you so much!

[@gskim]

This video is definitely the best I've ever seen about Transformers

[@jbhuang0604]

Thank you so much for your kind words.

[@4thlord51]

I know this already, but I love your explanation as refreshers.

[@jbhuang0604]

That’s great to hear! Thanks for your kind words!

[@DhaneshKasinathanlove]

Best transformer explanation. Thanks

[@jbhuang0604]

Glad it was helpful!

[@hung-yutseng9407]

Dada tooo wei

[@jbhuang0604]

Thank you da da!