Confused which Transformer Architecture to use? BERT, GPT-3, T5, Chat GPT? Encoder Decoder Explained

[@datafuseanalytics]

In this video, I tried to explain all the major Transformer architectures. I have also explained the differences and training objective of each one of them. If you feel this video adds value in your life then please like, share and comment on this video and subscribe to this channel. If any suggestions and feedback then please drop in comment box.

[@aurkom]

It would have been awesome if all the models had the release year mentioned along with it as well. Helps to get a birds eye view of the timeline.

[@datafuseanalytics]

Hello. Yes, I am making a separate video on similar topic. It will be uploaded soon. Stay tuned my friend.

[@milindkubal2738]

Amazing. Great work👍

[@datafuseanalytics]

Thanks Milind

[@rembautimes8808]

Excellent video and I joined as a sub. Like this style of going thru the various architectures and the use case. Maybe you can also update it with GPT 4 since it’s new out there.

[@datafuseanalytics]

Thanks a lot for this amazing comment. I have uploaded the latest video using ChatGPT model - th-cam.com/video/MKHEaxdoqxA/w-d-xo.html
Please go through it and feel free to comment

[@snehotoshbanerjee1938]

Great summary!!

[@MJunaid-s6g]

thank you sir ! Fantastic method of explanation

[@datafuseanalytics]

Hey buddy. Thanks a lot. 😀

[@datafuseanalytics]

Hey buddy. Thanks a lot

[@santoshpanigrahi5711]

Thanks for sharing. It's very informative. Keep up with this work.

[@datafuseanalytics]

Thank you, Santosh, for watching the video.

[@ganeshkharad]

this is really nice explaination!!!

[@datafuseanalytics]

Thanks a lot Ganesh 😃 🙏

[@ajitkumar15]

Very nice and to the point video, thank you !!!

[@datafuseanalytics]

Hey thanks a lot Ajit 😃 🙏

[@kevon217]

thanks for the excellent, well-explained summary!

[@datafuseanalytics]

Thank you Kevin

[@hemantwani4757]

Very nicely explained ❤👍

[@sagar3482]

Informative content
Thanks for sharing this

[@datafuseanalytics]

Glad you liked it!

[@amortalbeing]

thanks a lot❤

[@datafuseanalytics]

You are most welcome 😃 Do check other videos too on AI on this channel.

[@SaketKumar-wy1wb]

This is good. Keep up the good work. 🙂

[@datafuseanalytics]

Thank you Saket, I will

[@sanjaybhalke8032]

Thanks for sharing

[@datafuseanalytics]

My pleasure

[@exxzxxe]

Well done!

[@datafuseanalytics]

Thanks David.

[@falknfurter]

I just found this video and it's very good. I'm currently trying to understand when to use what type of model. Looking at Huggingface is just overwhelming. That's where this video jumps in and provides an excellent overview of the major models. I wish there would be a similiar video explaining the various pretraining objectives.

[@datafuseanalytics]

Hello. I will definitely make a video on the same. Thanks a lot. 😀

[@ahmedelsabagh6990]

Greate video!

[@datafuseanalytics]

Thanks a lot. Please do share it with your friends 😁

[@adityakshirsagar1391]

Informative 👍

[@datafuseanalytics]

Glad it was helpful and informative for you Aditya. Please do share it with your friends. More interesting videos will be uploaded soon

[@d4munche3z]

Can you create a tutorial on Longformer and the concepts/code used to adapt an LLM for larger token sizes?

[@datafuseanalytics]

Hello David. I haven't made it yet. But I will definitely make one on Longformer etc which takes a whopping 4096 tokens as input. Thanks for your feedback.

[@sarc007]

Excellent

[@datafuseanalytics]

Thanks a lot Suhail.

[@markfallu2389]

Great summary- would be good if you did an update

[@datafuseanalytics]

Sure. I will make an updated video comprising of all the possible model architectures

[@WillBeebe]

Superb 🎉

[@datafuseanalytics]

Hey thanks William

[@mhaya1]

Kudos🎉

[@datafuseanalytics]

Thank you 😃

[@chenpeter7428]

It seems it does not cover BERT in computer vision.

[@datafuseanalytics]

Yes you are right Chen Peter

[@ianboyles2425]

there's some new important ones like the newer gpt Neo models, alpaca, llama, cereus, vicuna

[@datafuseanalytics]

Hello Ian. Yes. At the time of this session, these models weren't available. Thank you for your feedback. I will definitely make one video (part 2) which will encompass these models in a more simpler fashion

[@tilkesh]

Thx

[@datafuseanalytics]

Most welcome 😃 😊

[@projectbit2248]

Hello, how do I contact/ connect with you, with regards to a project?

[@datafuseanalytics]

Hello, please contact us via our email. [e-mail]

[@ko-Daegu]

this sounds like copy pasted from online articles and just reading from them without extra info at all

[@datafuseanalytics]

Hey Ko-Jap. I referred multiple books for the same and then wrote the content in my language. But I did not refer to any online blogs or articles. Only books are the reference. But thank you for your valuable feedback. I will improve so that it doesn't sound as I am reading. 🙏😀

[@yosup125]

for the algo

[@datafuseanalytics]

Thank you

[@gregbugaj]

Nice overview

[@datafuseanalytics]

Hey Thanks a lot 😃

[@saketkr]

This is good. Keep up the good work. 🙂

[@datafuseanalytics]

Hey Thanks Saket