BERT Neural Network - EXPLAINED!

แชร์
ฝัง
  • เผยแพร่เมื่อ 3 ม.ค. 2025

ความคิดเห็น • 332

  • @CodeEmporium
    @CodeEmporium  ปีที่แล้ว +10

    For details and code on building a translator using a transformer neural network, check out my playlist "Transformers from scratch": th-cam.com/video/QCJQG4DuHT0/w-d-xo.html

  • @brilliantdirectoriestraining
    @brilliantdirectoriestraining 3 ปีที่แล้ว +146

    I have studied for several years AI, NPL and Neural networks. But the way you explained this was lovely, friendly and very simple which is why I am pretty sure you are BERT

  • @AmandeepSingh-xk4yv
    @AmandeepSingh-xk4yv 4 ปีที่แล้ว +248

    Just watched a video on Transformers, and now this. Am astounded at how you explained such complex notions with such ease!
    Hugely underrated channel!

    • @CodeEmporium
      @CodeEmporium  4 ปีที่แล้ว +7

      Thanks a lot! Glad you liked it 😊

  • @krishnaik06
    @krishnaik06 4 ปีที่แล้ว +212

    Amazing Explanation :)

    • @doyourealise
      @doyourealise 4 ปีที่แล้ว +1

      big fan sir

    • @richarda1630
      @richarda1630 3 ปีที่แล้ว

      hear hear! so agree!

    • @User-nq9ee
      @User-nq9ee 3 ปีที่แล้ว +2

      To teach us , you study and explore .. really grateful for your efforts Krish .

    • @indgaming5452
      @indgaming5452 2 ปีที่แล้ว

      Where there is krish sir... I will come there. .... Sir I found u here also...
      We are learning together 😇

    • @itsme1674
      @itsme1674 2 ปีที่แล้ว

      Nice to meet you sir

  • @TSP-NPC
    @TSP-NPC ปีที่แล้ว

    Thanks for the great explanation of Transformers and the architecture of BERT.

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว

      My pleasure and thank you for the super thanks :)

  • @xJFGames
    @xJFGames 2 ปีที่แล้ว +6

    I'm honestly amazed of how you managed to transform a complex algorithm in a simple 10 minutes video. Much thanks to you, my final thesis appreciates you.

  • @prasannabiswas2727
    @prasannabiswas2727 4 ปีที่แล้ว +1

    I read many blogs on BERT but they were more focused on how to use BERT rather than what actually BERT is?. This video helped me clear all my doubts regarding how Bert is trained. Clear and concise explanation.

  • @healthertsy1863
    @healthertsy1863 ปีที่แล้ว

    Don't hesitate, this is the best video of BERT explanation for sure!

  • @ziangtian
    @ziangtian ปีที่แล้ว +1

    OMG!!!! This vid is a life-saver! just elucidated so many aspects of NLP to me (a 3 month beginner who still understands nothing

  • @usamahussain4461
    @usamahussain4461 2 ปีที่แล้ว +4

    Phenomenal the way you condense such a complicated concept into a few minutes, clearly explained.

    • @CodeEmporium
      @CodeEmporium  2 ปีที่แล้ว

      Thanks so much for the compliments:)

  • @jeenakk7827
    @jeenakk7827 4 ปีที่แล้ว +24

    I wish I had come across this channel earlier. You have a wonderful skill in explaining complicated concepts. I love your "3 pass" approach!!

  • @michaelherrera4450
    @michaelherrera4450 4 ปีที่แล้ว +5

    Dude this video is incredible. I cannot express how good you are at explaining

    • @CodeEmporium
      @CodeEmporium  3 ปีที่แล้ว

      Thanks for watching! Super glad it is useful

    • @path1024
      @path1024 ปีที่แล้ว

      Good try though!

  • @madhubagroy
    @madhubagroy 3 ปีที่แล้ว +1

    The BEST explanation on BERT. Simply outstanding!

  • @erfanshayegani3693
    @erfanshayegani3693 ปีที่แล้ว

    Every time I watch this video I gain a better understanding of the procedure. Thanks a lot for the great content!!!

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว

      Anytime! Look forward for more

  • @akhileshpandey123
    @akhileshpandey123 ปีที่แล้ว

    Always come back to your explanation whenever want to refresh bert concepts. Thanks for the effort.

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว

      Thanks for the super kind words :)

  • @NadavBenedek
    @NadavBenedek 2 ปีที่แล้ว

    I love the "pass1" "pass2" concept of how you explain things. It's great.

  • @rajeshve7211
    @rajeshve7211 7 หลายเดือนก่อน

    Best ever explanation of BERT! Finally understood how it works :)

  • @NachoProblems
    @NachoProblems ปีที่แล้ว

    Do you realize you are the only good description of how exactly fine tuning works I have found, and I've been researching for months. Thank you!!!

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว +1

      You are too kind. Thank you for the donation. You didn’t have to bug it is appreciated. Also super glad this content was useful! More of this to come

  • @pallavijog912
    @pallavijog912 4 ปีที่แล้ว

    Wow.. just switched from another BERT explained video to this.. stark difference.. excellent explanation indeed.. thanks..

  • @mauriciolandos4712
    @mauriciolandos4712 ปีที่แล้ว

    Best explanator on youtube, you have a good mix of simplifying so it can be understood, but not overly simplifying so we learn deeply enough. The idea of having 3 passes going deeper was a great idea as well.

  • @sumontasaha5638
    @sumontasaha5638 หลายเดือนก่อน

    God Level Explanation. Thanks Man !

  • @rohanmirchandani9726
    @rohanmirchandani9726 3 ปีที่แล้ว

    This is one of the best resources explaining BERT available online.

  • @BogdanSalyp
    @BogdanSalyp 4 ปีที่แล้ว +1

    Extremely underrated channel, didn't find any other good explanation on TH-cam/Medium/Google

  • @goelnikhils
    @goelnikhils 2 ปีที่แล้ว

    Excellent Explanation. Main thing to note is the finer point around explanation/mention of the loss functions that BERT uses. As not many other videos on same topic cover this. Tood Good

  • @AbdulWahab-cy9ib
    @AbdulWahab-cy9ib 4 ปีที่แล้ว +1

    Was struggling to understand the basics of BERT after going through Transformer model. This video was indeed helpful.

  • @mays7n
    @mays7n ปีที่แล้ว

    this must be one of the best explanation videos on the internet, thank you!

  • @ydas9125
    @ydas9125 ปีที่แล้ว

    I am very impressed by the clarity and core focus of your explanations to describe such complex processes. Thank you.

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว

      You are very welcome. Thanks for watching and commenting :)

  • @deepeshkumar4945
    @deepeshkumar4945 ปีที่แล้ว

    dude , you are amazing , you explained the state of the art NLP model , in such a well explained and concise video . Thanks a ton for this video !!!!!!

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว +1

      You are super welcome. Thanks so much for commenting this!

  • @shrawansahu9500
    @shrawansahu9500 2 ปีที่แล้ว

    Wow , Best Explanation on BERT present in TH-cam that too Free, Thanks Man you made NLP easy.🍺

    • @CodeEmporium
      @CodeEmporium  2 ปีที่แล้ว

      Glad! Thanks a ton for watching

  • @bidyapatip
    @bidyapatip 4 ปีที่แล้ว

    After reading lot of blogs, videos, I understood its so difficult network. But after going through this, I feel so easy to understand BERT(and its varient available in transformer library)

  • @aeirya1686
    @aeirya1686 ปีที่แล้ว

    Very very friendly, clear and masterful explanation. This is exactly what I was after. Thank you!

  • @ankit_khanna
    @ankit_khanna 3 ปีที่แล้ว

    One of the best videos on BERT.
    Great work!
    Wishing you loads of success!

  • @andrewlai3358
    @andrewlai3358 4 ปีที่แล้ว +3

    Thank you for the explanation. You really have a knack for explaining NLP concepts clearly without losing much fidelity. Please keep posting!

  • @josephselwan1652
    @josephselwan1652 3 ปีที่แล้ว +1

    Amazing stuff. For visualization purposes, when you get into a deeper pass, I would recommend always adding the zooming effect for intuitive understanding. I am not sure about others, but when you do that, I instantly know "OK, now we are within this 'box' "

    • @CodeEmporium
      @CodeEmporium  3 ปีที่แล้ว +2

      Good thought. I'll try to make this apparent in the future. Thanks!

  • @somerset006
    @somerset006 ปีที่แล้ว

    Nice job, man! Especially the multi-phase approach of explaining things, top to bottom.

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว

      Super happy you liked the approach. Thanks for commenting

  • @jan-rw2qx
    @jan-rw2qx ปีที่แล้ว

    First half is exactly how much I need to understand right now, thank you :)

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว

      Awesome! You are very welcome!

  • @andymoses95
    @andymoses95 4 ปีที่แล้ว +1

    The one which I was looking for the past 6 months.! Thanks a lot for making this.

    • @CodeEmporium
      @CodeEmporium  4 ปีที่แล้ว

      I'm late. But. Here now!

  • @maverick3069
    @maverick3069 4 ปีที่แล้ว +1

    The multiple passes of explanation is an absolutely brilliant way to explain! Thanks man.

  • @rahuldey6369
    @rahuldey6369 3 ปีที่แล้ว

    I've read 4 articles before coming here. Couldn't connect the dots. This single video showed me the way.. Thanks a lottt

    • @CodeEmporium
      @CodeEmporium  3 ปีที่แล้ว +1

      Super glad it helped :)

  • @harshavardhany2970
    @harshavardhany2970 3 ปีที่แล้ว +1

    Simple and clear explanations (which shows you know what you're talking about). And cool graphics. Will be back for more videos :)

  • @JP-gk6pi
    @JP-gk6pi 4 ปีที่แล้ว

    3 pass explanation is a really good approach to explain this complex concept. Best video on BERT

    • @beteaberra
      @beteaberra 3 ปีที่แล้ว

      Great video! But what is pass 1, pass 2 and pass 3?

  • @alidi5616
    @alidi5616 3 ปีที่แล้ว

    That's it. The best explanation i came through. Receive my upvote and subscription 😁

    • @CodeEmporium
      @CodeEmporium  3 ปีที่แล้ว

      Many thanks. Join the discord too :3

  • @gauravchatterjee794
    @gauravchatterjee794 3 ปีที่แล้ว

    Best Explanation by far!

  • @aruncjohn
    @aruncjohn 4 ปีที่แล้ว

    Excellent explanation!. Will never miss a video of yours from now on!

  • @muhannadobeidat
    @muhannadobeidat 2 ปีที่แล้ว

    Excellent introduction, visualizations and step by step approach to explain this. Thanks a ton.

    • @CodeEmporium
      @CodeEmporium  2 ปีที่แล้ว

      You are oh-so welcome. Thank you for watching and commenting:)

  • @ParthivShah
    @ParthivShah 5 หลายเดือนก่อน

    Thank You. Love from India.

  • @abhikc8108
    @abhikc8108 4 ปีที่แล้ว +3

    Great explanation, I really like the three pass idea it breaks down a lot of complications to simple concepts.

  • @aitrends8901
    @aitrends8901 2 ปีที่แล้ว

    Very nice high level understanding of Transformers...

  • @jx7433
    @jx7433 10 หลายเดือนก่อน

    Excellent Explanation! Thank you!

  • @BiranchiNarayanNayak
    @BiranchiNarayanNayak 4 ปีที่แล้ว

    Best explanation i have seen so far on BERT.

  • @20.nguyenvongockhue80
    @20.nguyenvongockhue80 9 หลายเดือนก่อน

    wow AMAZING EXPLAINATION. Thank you very much

  • @seeunkim4185
    @seeunkim4185 2 ปีที่แล้ว

    Thank you so much for the clear explanation, I get the grip of the BERT now!

  • @aashnavaid6918
    @aashnavaid6918 2 ปีที่แล้ว

    thank you so very much! one video was enough to get the basics clear

  • @dannysimon2965
    @dannysimon2965 4 ปีที่แล้ว

    Wow, thanks!! I tried watching many videos and couldn't understand a single thing. But yours was truly concise and informative.

  • @atamir8339
    @atamir8339 6 หลายเดือนก่อน

    loved your explanation bro, earned yourself a sub

  • @adityaj9984
    @adityaj9984 ปีที่แล้ว

    BEST EXPLAINATION EVEERRRR

  • @amreshgiri
    @amreshgiri 4 ปีที่แล้ว

    Probably the best (easiest to understand in one go) video on BERT. Thanks ❤️

  • @utkarshujwal3286
    @utkarshujwal3286 ปีที่แล้ว

    The NSP task does not directly involve bidirectional modeling in the same way as masked language modeling (MLM) does. Instead, it serves as a supplementary objective during BERT's pre-training phase. The purpose of the NSP task is to help the model understand relationships between sentences and capture broader context beyond adjacent words.

  • @pathuri86
    @pathuri86 2 ปีที่แล้ว

    Excellent and concise explanation. Loved it. Thanks for this fantastic video.

  • @themaninjork
    @themaninjork 3 ปีที่แล้ว

    Your Videos are very well explained !

  • @mohsennayebi86
    @mohsennayebi86 2 ปีที่แล้ว

    Amazing Explanation! I am speechless :)

  • @arturjaroszewicz8424
    @arturjaroszewicz8424 10 หลายเดือนก่อน

    Beautiful explanation!

  • @maryamaziz3841
    @maryamaziz3841 3 ปีที่แล้ว

    Thanks for wonderful explanation for bert architecture 🍀🌹

  • @sajaal-dabet148
    @sajaal-dabet148 3 ปีที่แล้ว +1

    This is amazing! Crystal clear explanation, thanks a lot.

  • @ruyanshou805
    @ruyanshou805 3 ปีที่แล้ว

    Well explained! I have been looking for something like this for quite long!

  • @LoLelfy
    @LoLelfy 3 ปีที่แล้ว

    Omg your videos are so good! So happy I found your channel, I'm binge watching everything :D

    • @CodeEmporium
      @CodeEmporium  3 ปีที่แล้ว +1

      Glad you found my channel too! Thank you! Hope you enjoy them!

  • @akashsaha3921
    @akashsaha3921 4 ปีที่แล้ว

    Well explained. Short and to the point

  • @sudharshantr8757
    @sudharshantr8757 2 ปีที่แล้ว

    At 7:55 , the position embeddings as said in the video encodes the position of a word in a sentence. But in the slide, the sequence of position embeddings if E0..E5,E6,E7..E10 instead of E0..E5,E0,E1..E5 (implying position embedding of a word depends on how the 2 sentences are arranged)

  • @urd4651
    @urd4651 2 ปีที่แล้ว

    thank you for sharing the video! very clear and helpful!!

  • @dhananjaysonawane1996
    @dhananjaysonawane1996 4 ปีที่แล้ว

    @11:08 Please go on forever :):D... the best explanation I have seen so far, Thanks man!

  • @Kumar08
    @Kumar08 4 ปีที่แล้ว

    Fantastic explanation, Covered each and every point in the BERT.
    Looking forward for more videos on NLP.

  • @JillRhoads
    @JillRhoads ปีที่แล้ว

    Im a teacher with a compi-sci masters and am just diving into AI. This was absolutely great! I studied natural language in college about 20 years ago and this video really helped form a mental bridge with the new technologies. Language chatbots have been around forever!and the ones I studied used Markov chains that used small corpuses. So of course students would dump porn novels, the bibel and whatnot into it and then start it talking. We never laughed so hard!

  • @magelauditore333
    @magelauditore333 4 ปีที่แล้ว

    Such a underrated channel. Keep it up man

  • @keyrellousadib6124
    @keyrellousadib6124 2 ปีที่แล้ว

    This is an excellent summary. Very clear and super well organized. Thanks very much

    • @CodeEmporium
      @CodeEmporium  2 ปีที่แล้ว

      Thank you so much for watching ! And for the wonderful comment :$

  • @ilyasaroui7745
    @ilyasaroui7745 4 ปีที่แล้ว

    Good touch to put the references on the description instead of on the slides

  • @ngavu8750
    @ngavu8750 2 ปีที่แล้ว

    So simple and easy to understand, thanks a lot

    • @CodeEmporium
      @CodeEmporium  2 ปีที่แล้ว

      Super glad this was useful :)

  • @arvindvasudevan45
    @arvindvasudevan45 4 ปีที่แล้ว

    Excellent articulation of the concept. Thank you.

  • @caoshixing7954
    @caoshixing7954 4 ปีที่แล้ว

    Very good explanation, Easy to understand! Come on!

  • @felixakwerh5189
    @felixakwerh5189 4 ปีที่แล้ว

    great video, i like the 3-pass method you used to explain the concepts

  • @pinakjani4281
    @pinakjani4281 4 ปีที่แล้ว +1

    No one explains DL models better than this guy.

  • @nooshnabi9248
    @nooshnabi9248 3 ปีที่แล้ว

    Great Video! So easy to follow!

  • @sathyakumarn7619
    @sathyakumarn7619 3 ปีที่แล้ว

    Not bad! Loved the video. Please add a little bit of more explanation for upcoming vids if preferrable.

  • @rashmikuchhal5339
    @rashmikuchhal5339 4 ปีที่แล้ว

    I always watch your videos and appreciate the efforts you put to make the complicated topics so easy and clear. Thankyou for all your work. I really like the way you explain in 3 passes.... great work

  • @MarketingLeap
    @MarketingLeap 4 ปีที่แล้ว

    Loved how you explained BERT really well. Great job!

  • @Deddiward
    @Deddiward 3 ปีที่แล้ว

    Wow I've just discovered your channel, it's full of resources, very nice!

  • @dupontremi5638
    @dupontremi5638 2 ปีที่แล้ว

    great explanation, I understood everything ! thanks a lot

    • @CodeEmporium
      @CodeEmporium  2 ปีที่แล้ว

      Thanks so much for watching and commenting :)

  • @agustindiaz3361
    @agustindiaz3361 4 ปีที่แล้ว

    Your videos are great! Amazing work

  • @쉔송이
    @쉔송이 4 ปีที่แล้ว

    Hey, your explantation and presentation on complicated concepts made me clear about TF and BERT.
    I will expect you to upload more exciting videos.

  • @josephpareti9156
    @josephpareti9156 2 ปีที่แล้ว

    awesome introduction to a very challenging topic

    • @CodeEmporium
      @CodeEmporium  2 ปีที่แล้ว

      Thank you. Uploading a related video on this soon too :)

  • @susantachary7456
    @susantachary7456 3 ปีที่แล้ว

    No more reading after this. Loved IT. 😊

  • @dharmendrathakur1487
    @dharmendrathakur1487 3 ปีที่แล้ว

    Big Big Thanks to make such awesome Videos..

  • @yuri-nehc
    @yuri-nehc ปีที่แล้ว

    very good explanation! thank you!

  • @mohamedsaaou9258
    @mohamedsaaou9258 4 ปีที่แล้ว

    Wonderful, and the best explanation of BERT ever :) , Good Job , and big thank you !

  • @prathyusha5393
    @prathyusha5393 4 ปีที่แล้ว

    Thanks a bunch for these wonderful videos!

  • @pratyushnegi4082
    @pratyushnegi4082 2 ปีที่แล้ว

    Thanks for explaining this in such a simple way :)

  • @noumaaaan
    @noumaaaan 3 ปีที่แล้ว

    This explanation is pretty amazing! I have a presentation on this soon. Thank you so much!

  • @snowglade1
    @snowglade1 4 ปีที่แล้ว

    Hey this is an exceptional training video.

  • @jeflee2787
    @jeflee2787 4 ปีที่แล้ว

    Thanks man! Great work!

  • @fahnub
    @fahnub ปีที่แล้ว

    Thank you so much for these videos.

    • @CodeEmporium
      @CodeEmporium  ปีที่แล้ว +1

      You are welcome! Thanks so much for commenting! Really appreciate it :)

  • @rodrigomaldonado5280
    @rodrigomaldonado5280 3 ปีที่แล้ว

    new subscriber, amazing explanation!