Illustrated Guide to LSTM's and GRU's: A step by step explanation

แชร์
ฝัง
  • เผยแพร่เมื่อ 18 ก.ย. 2018
  • LSTM's and GRU's are widely used in state of the art deep learning models. For those just getting into machine learning and deep learning, this is a guide in plain English with helpful visuals to help you grok LSTM's and GRU's.
    Subscribe to receive video updates on practical Artificial Intelligence and it's applications.
    Also, comment below and let me know what'd you like to see next!
    ⭐ Play and Experiment With the Latest AI Technologies at grandline.ai ⭐
    Sources
    www.wildml.com/2015/10/recurre...
    colah.github.io/posts/2015-08-...
    • Recurrent Neural Netwo...
    Catch me on the web for more AI content
    www.learnedvector.com

ความคิดเห็น • 454

  • @theaihacker777
    @theaihacker777  5 ปีที่แล้ว +62

    I create much more contents like this! if you enjoy this, check out my other content at www.michaelphi.com

    • @mallarihiteshkumar4584
      @mallarihiteshkumar4584 5 ปีที่แล้ว +1

      Hello sir, Ive understood the concept but I couldnt able to trace it on a paper with an example(bit confusing in tracing how the values changes from one layer to layer and how the updations are occurs ),if u have any simple example with tracing each and every step it will be much helpful for me(just a simple example with minimumal data ,and how to train,how to test)
      hope u will check this out and reply soon sir,
      thank you sir

    • @mallarihiteshkumar4584
      @mallarihiteshkumar4584 5 ปีที่แล้ว

      OR else suggest any blog or book that has step to step explaination.

    • @alexmcinteercodegrowloopll6780
      @alexmcinteercodegrowloopll6780 4 ปีที่แล้ว

      hey, we are neighbors, i was just scrolling across youtube and found this

    • @mehmetaliozer2403
      @mehmetaliozer2403 4 ปีที่แล้ว

      I finally find a nice explanation to understand lstm metworks. thanks a lot. 👍

    • @akashchandra2223
      @akashchandra2223 3 ปีที่แล้ว

      Can you tell me how long it takes

  • @bounames
    @bounames 5 ปีที่แล้ว +153

    Finally a very clear explanation of LSTM's. Thank you.

  • @JohnDoe-fy5ws
    @JohnDoe-fy5ws 4 ปีที่แล้ว +128

    Great video! A little suggestion: pump up the volume on your output because it was a little quiet. Other than that, your video was great and it was easily the best one on the topic that I could find. I'm a visual learner, so your diagrams really helped when no other videos could. Thanks again.

    • @AravindUkrd
      @AravindUkrd 26 วันที่ผ่านมา

      Also remove background noise or try using a better mic :)

  • @theaihacker777
    @theaihacker777  5 ปีที่แล้ว +11

    For the readers, the written version can be found here towardsdatascience.com/illustrated-guide-to-lstms-and-gru-s-a-step-by-step-explanation-44e9eb85bf21 Thanks for watching :)

  • @ashishk81
    @ashishk81 5 ปีที่แล้ว +4

    cant express my happiness after watching this..finally understand LSTM thanks a lot !!!
    best animation and explanation method , keep doing this ...

  • @harsharip
    @harsharip 4 ปีที่แล้ว +2

    Give this man a cheer. Finally, I understood what is going on inside that LSTM cell.

  • @shubhamk53
    @shubhamk53 5 ปีที่แล้ว +13

    One of the Finest Concept Video and coolest animation I have seen on TH-cam. You are awesome Bro.

  • @sansin-dev
    @sansin-dev 4 ปีที่แล้ว +25

    The best explanation of different RNN operations I have seen so far, and I have seen most of them on TH-cam. Those animations really hit home. Keep up the good work, Mikael.
    I am curious to know what's up with all the thumbs-downers.

  • @layjain9739
    @layjain9739 4 ปีที่แล้ว +8

    This is clear, comprehensive, and overall amazing. Thanks a lot.

  • @TheRefraX
    @TheRefraX 5 ปีที่แล้ว +1

    This is most intuitive explanation of LSTM's I've come across. Thank you!

  • @ntp1235
    @ntp1235 5 ปีที่แล้ว +26

    This is what ,I was looking for.... Thank you very much,waiting for next video,Subscribed

  • @user-nx8ux5ls7q
    @user-nx8ux5ls7q 3 ปีที่แล้ว

    I tried to understand this since 2016, gave up so many times. Now finally I understood. Thank you so much! Can't thank you enough!

  • @seyedmatintavakoliafshari8272
    @seyedmatintavakoliafshari8272 2 ปีที่แล้ว +1

    It's quite artistic how you can pull off these subjects with minimalistic animations! Really helpful. Thanks.

  • @_rohitag
    @_rohitag 5 ปีที่แล้ว +1

    Explaining it visually along with code did wonders for my understanding. Thanks a lot. Keeping making such gems.

  • @MrJerry32323
    @MrJerry32323 5 ปีที่แล้ว

    Clear explanation, cool animation, awesome presentation... THE BEST TUTORIAL I'VE EVER SEEN!

  • @liyuqi3779
    @liyuqi3779 ปีที่แล้ว +1

    Excellent animated demonstrations! Better than ten Coursera courses combined in explaining LSTM

  • @ThomasPanji
    @ThomasPanji 4 ปีที่แล้ว +1

    Finally i found the explanation of these layers. Thank you!!

  • @munna427
    @munna427 5 ปีที่แล้ว

    You were good in explaining the difference between the LSTM and GRU.. Served the purpose I was looking for.. thx

  • @cgmiguel
    @cgmiguel ปีที่แล้ว

    This is one of the most clear explanation of a LSTM I’ve seen!

  • @mokshnigamsatsangi1780
    @mokshnigamsatsangi1780 5 ปีที่แล้ว

    I've been waiting for such animated explanation of LSTMs from a long time. Thanks a billion for this though.
    Super nice and catchy ! I hope you cover maximum deep learning topics with this approach !!!

  • @borispapic9510
    @borispapic9510 5 ปีที่แล้ว +43

    Hey bud you're making great content, subbed. I'm convinced you'll become huge soon. Good luck!

    • @theaihacker777
      @theaihacker777  5 ปีที่แล้ว +3

      Hey Boris Papić! Thank you so much for the kind words :) more content coming soon!

  • @LayneSadler
    @LayneSadler 4 ปีที่แล้ว +2

    this was incredible! thank you. very cool that the cell is a NN unto itself. hidden state is the memory and output is the activation value of the cell.

  • @SunilKumar-kt3sc
    @SunilKumar-kt3sc 5 ปีที่แล้ว +4

    Awesome presentation of this complex mechanism!

  • @devanshyadav4851
    @devanshyadav4851 3 ปีที่แล้ว

    Your animation for explaining things in simplest way is awesome

  • @mahshida5557
    @mahshida5557 5 ปีที่แล้ว +1

    Fantastic visuals and clear explanation. Thank you!

  • @praneethcj6544
    @praneethcj6544 4 ปีที่แล้ว +3

    I read your article on towards data science
    Very intuitive explanation ... You deserve respect sir..!!!
    Make more videos on deep learning
    Educate us more sir

  • @mickiq
    @mickiq 5 ปีที่แล้ว

    Thanks for creating this illustration - super intuitive and straightforward!

  • @mishalubich7141
    @mishalubich7141 2 ปีที่แล้ว

    Wow, this is a gem in the AI tutorial space!! Thank you so much!

  • @datngo2852
    @datngo2852 4 ปีที่แล้ว

    Amazing Job Mikael! Very well done! Thanks for explaining so eloquently!

  • @nj8048
    @nj8048 ปีที่แล้ว

    The best RNN explanation i've watched so far. Thank you!

  • @LopitalBB
    @LopitalBB 2 ปีที่แล้ว

    The best explanation of LSTM ever! Thank you!

  • @lightyagmi4925
    @lightyagmi4925 4 ปีที่แล้ว

    This is the best explanation i ever saw on LSTM

  • @jellybella9694
    @jellybella9694 5 ปีที่แล้ว

    Thanks for ur explanation, which makes the concept crystal clear!!

  • @thomasdemunck4326
    @thomasdemunck4326 3 ปีที่แล้ว

    Complicated concepts explained simply, you won a subscriber.

  • @sniperzrx
    @sniperzrx 2 ปีที่แล้ว

    These visualizations and explanations are just amazing

  • @ahmedhany5037
    @ahmedhany5037 5 ปีที่แล้ว

    Can't wait for more videos from you ! Keep it up !

  • @beatlekim
    @beatlekim 4 ปีที่แล้ว

    This is the best explanation of LSTM finally

  • @mubarkali3340
    @mubarkali3340 4 ปีที่แล้ว

    finally, what I been looking for, very clear explanation, thank you so much for posting this video.

  • @perwaaler
    @perwaaler 8 หลายเดือนก่อน

    Thank you, this is the clearest explanation of LSTM I've found by far! Perfect mixture of mathematical detail (no math is too little imo) and visualisations and metaphors for a high level conceputal understanding (very hard to find on this subject). LSTMs are hard to understand, at least they have been for me, so I really appreciate this!

  • @rahulrai1329
    @rahulrai1329 4 ปีที่แล้ว

    Very nice and intuitive explanation.Thanks a lot for letting me understand the concepts of LSTM and GRU

  • @manueldeodati1728
    @manueldeodati1728 ปีที่แล้ว

    finally a clear and detailed explanation.. thank you !

  • @SuperHddf
    @SuperHddf 2 ปีที่แล้ว

    You are the best so far of all I watched about LSTMs on TH-cam!

  • @richsajdak
    @richsajdak 2 ปีที่แล้ว

    Thank you very much for this explanation. I finally understand what's happening in LSTMs

  • @Rahidt100
    @Rahidt100 3 ปีที่แล้ว

    This is the best explanation of LSTM !

  • @PierLim
    @PierLim 5 ปีที่แล้ว

    One of the best explanations on lstm, subbed!

  • @143balug
    @143balug 4 ปีที่แล้ว

    very very clear explanation of LSTM's. Thank you bro

  • @shaelanderchauhan1963
    @shaelanderchauhan1963 4 ปีที่แล้ว

    Amazing stuff man please make full series on Deep learning you far better than most of the instructors online.

  • @siddharthpal7022
    @siddharthpal7022 3 ปีที่แล้ว

    Excellent job explaining LSTMs!

  • @peter-holzer-dev
    @peter-holzer-dev ปีที่แล้ว

    Your animations help a lot in understanding! Many thanks for doing this! 🙏

  • @bilincinontolojikizdirabi
    @bilincinontolojikizdirabi 3 ปีที่แล้ว

    OMG this video explains perfect such a complex object! THX

  • @user-td8vz8cn1h
    @user-td8vz8cn1h 7 หลายเดือนก่อน

    Thanks for such an amazing animations. They definitely contribute to better understanding of the given concepts.

  • @mauriciogtec
    @mauriciogtec 5 ปีที่แล้ว

    Amazingly well-explained and concise!

  • @cicadaman1317
    @cicadaman1317 4 ปีที่แล้ว +1

    Thanks Michael! This was a great supplement to Chris Olah's blog post.

  • @akbarghurbal
    @akbarghurbal 4 ปีที่แล้ว

    One of the best explanation of LSTM networks!

  • @orinc370
    @orinc370 3 ปีที่แล้ว

    Clear explanation- thank you!!

  • @muhammadshoaibsikander2603
    @muhammadshoaibsikander2603 5 ปีที่แล้ว

    Excellent illustration and explanation. Thank you!

  • @behrouzbeheshti
    @behrouzbeheshti ปีที่แล้ว

    Just AMAZING! Many thanks.

  • @guandongkou178
    @guandongkou178 2 ปีที่แล้ว +7

    Amazing! This 11-minute video is more informational and inspiring than those 2-hour lectures from most college professors!

  • @cleverclover7
    @cleverclover7 5 ปีที่แล้ว +1

    This is so good and clear. Thank you!

  • @gajuahmed4426
    @gajuahmed4426 2 ปีที่แล้ว

    Thanks, buddy! You prove me wrong again and what an explanation in a different way.

  • @gururaj4037
    @gururaj4037 5 ปีที่แล้ว

    Perfect Bro. Thanks a lot. U made LSTMs a cute little toy, to play with.

  • @TheDV1Zone
    @TheDV1Zone 3 ปีที่แล้ว

    Objectively the best video to understand RNN cells.

  • @mwdcodeninja
    @mwdcodeninja 4 ปีที่แล้ว

    An excellent walkthrough! Thank you!

  • @ehsanhonarvar
    @ehsanhonarvar 2 ปีที่แล้ว

    Very excellent and useful! Thank you Mr. Phi!

  • @AdityaAbhiram
    @AdityaAbhiram 4 ปีที่แล้ว

    Great work! This is the type of video I've been looking for! Thanks!

  • @peterokonma5741
    @peterokonma5741 2 ปีที่แล้ว

    Thanks, this video is one of the best I have seen on the subject. Thanks also for follow up link for deeper understanding.

  • @zarena50
    @zarena50 3 ปีที่แล้ว

    Bravo! Thank you for the clear explaination.

  • @serdilanlunlu1419
    @serdilanlunlu1419 ปีที่แล้ว

    Thanks a lot for clear explanation, It is perfect with the use of animation.

  • @K_OAT
    @K_OAT ปีที่แล้ว

    Amazing explanation and visualization! Thank you.

  • @dheerajaryasomayajula7657
    @dheerajaryasomayajula7657 3 ปีที่แล้ว

    Super helpful video. Really enjoyed it as it provides good basic knowledge to understand LSTMs. Thank you. Keep em coming!

  • @cliffrunner
    @cliffrunner 2 ปีที่แล้ว

    I am only half way through the video but can't wait to leave my comments here. It is a very nice piece of work! Great job! I have been reading posts and watching videos that can help me understand RNN, LSTM and GRU, and this video is by far the best to illustrate the key ideas of these networks.

  • @deeporblabs9564
    @deeporblabs9564 3 ปีที่แล้ว

    Great overview. Will reference this video in our preparation. Thanks for sharing.

  • @mohammedahmedabdelkaway9805
    @mohammedahmedabdelkaway9805 3 ปีที่แล้ว

    Thank you for your perfect explanation and well illustration.

  • @jhpolaris4400
    @jhpolaris4400 5 ปีที่แล้ว

    Waiting for your new videos! What you made helps me a lot!

  • @GauravPadawe
    @GauravPadawe 4 ปีที่แล้ว

    best video I ever came across. Thanks a lot.

  • @muskangupta5873
    @muskangupta5873 3 ปีที่แล้ว +1

    This is what i was looking for... thanks Michael

  • @carlbaskerville5331
    @carlbaskerville5331 4 ปีที่แล้ว

    One of the Finest Concept Video and coolest animation I have seen on TH-cam. You are awesome Bro.
    Perfect Bro. Thanks a lot. U made LSTMs a cute little toy, to play with.

  • @tooshallpass
    @tooshallpass 2 ปีที่แล้ว

    You are amazing. Thanks for this crisp and clear explanation on this!

  • @fahdciwan8709
    @fahdciwan8709 4 ปีที่แล้ว

    simplifying complex stuff is a trait u shud b proud of

  • @ekleanthony7997
    @ekleanthony7997 3 ปีที่แล้ว

    Great Video. finally I found a video that clears my doubt on LSTM. THANKS for the awesome work!

  • @amirabouamrane7151
    @amirabouamrane7151 4 ปีที่แล้ว

    thanks I finally understand it ,great and easy explanation
    all the best

  • @satarupapanda7774
    @satarupapanda7774 4 ปีที่แล้ว

    Excellent explanation and visualization ... thank you Micheal...

  • @Carrienoburden
    @Carrienoburden 3 ปีที่แล้ว

    You have a great voice and a wonderful video! Thanks for helping me understand GRUs and LSTMs!

  • @chrisogonas
    @chrisogonas ปีที่แล้ว

    Simple and clear. Thanks

  • @JustinDS
    @JustinDS 2 ปีที่แล้ว

    This video was great! Made LSTMs and GRUs so easy to understand.
    🎓

  • @faithfullady1957
    @faithfullady1957 4 ปีที่แล้ว

    Great job Michael, an excellent introduction.

  • @Lord-V15
    @Lord-V15 3 ปีที่แล้ว

    Wonderful explanation. Helped me answer so many job interview questions. thank you so much !!

  • @derbicalderon6900
    @derbicalderon6900 3 ปีที่แล้ว

    Amazing video, thank you so much. Please keep up the good work.

  • @janosneumann1987
    @janosneumann1987 2 ปีที่แล้ว

    The best explanation of LSTMs on the web

  • @HybridSyntaX
    @HybridSyntaX 4 ปีที่แล้ว

    Best explanation ever in any topic, ever created.

  • @bhaveshvora93
    @bhaveshvora93 5 ปีที่แล้ว +1

    Thank you..it makes my morning knowledge..

  • @rafibasha1840
    @rafibasha1840 2 ปีที่แล้ว

    Thank you so much ,clearly explained

  • @kaleabwoldemariam4288
    @kaleabwoldemariam4288 2 ปีที่แล้ว

    Excellent, easy to understand, presentation.

  • @bayunugraha8614
    @bayunugraha8614 4 ปีที่แล้ว

    thank you so muchhhh. it help me so much to make other understand just by showing your vid.

  • @ashishbansod2036
    @ashishbansod2036 10 หลายเดือนก่อน

    Awesome videos, I like the way you explain with animation. waiting for more

  • @mohamedibrahimbehery3235
    @mohamedibrahimbehery3235 หลายเดือนก่อน

    This is gold, man. Thanks!

  • @BlackHermit
    @BlackHermit 4 ปีที่แล้ว

    This is a great illustrated guide to LSTM.

  • @nuru50
    @nuru50 4 ปีที่แล้ว

    This was amazing... I understood it in seconds

  • @suparnadutta6914
    @suparnadutta6914 ปีที่แล้ว

    Thank you.Your videos are amazing.

  • @saularellano1866
    @saularellano1866 ปีที่แล้ว

    Bro, I am writing my thesis and your videos of LSTM and Transformer have been key :D ... thank you a lot