Illustrated Guide to Recurrent Neural Networks: Understanding the Intuition

แชร์
ฝัง
  • เผยแพร่เมื่อ 24 ส.ค. 2018
  • If you enjoy this, check out my other content at www.michaelphi.com
    Recurrent Neural Networks are an extremely powerful machine learning technique but they may be a little hard to grasp at first. For those just getting into machine learning and deep learning, this is a guide in plain English with helpful visuals to help you grok RNN's.
    Subscribe to receive video updates on practical Artificial Intelligence and it's applications.
    Comment below and let me know what'd you like to see next!
    ⭐ Play and Experiment With the Latest AI Technologies at grandline.ai ⭐
    The written version of this video
    / illustrated-guide-to-r...
    Sources
    iamtrask.github.io/2015/11/15...
    colah.github.io/posts/2015-08-...
    Catch me on the web for more AI content
    www.learnedvector.com

ความคิดเห็น • 325

  • @theaihacker777
    @theaihacker777  5 ปีที่แล้ว +19

    Check out the written version on my blog!
    towardsdatascience.com/illustrated-guide-to-recurrent-neural-networks-79e5eb8049c9

    • @allenshakespeare5202
      @allenshakespeare5202 2 ปีที่แล้ว

      Hey Mike. Loved your informative video and your work. I am your FAN.

    • @yamininair5165
      @yamininair5165 7 หลายเดือนก่อน

      Could you help me visualize the RNN as a normal neural network with input layer and hidden layers etc.

    •  7 หลายเดือนก่อน

      Older videos = better and high quality

  • @diasmashikov7793
    @diasmashikov7793 3 ปีที่แล้ว +2

    Dude if you still hang out on this channel then thank you very much for clarifying the concept of RNN! You rock!!!

  • @akshaybareja4697
    @akshaybareja4697 3 ปีที่แล้ว +3

    This is the CLEAREST explanation of RNNs I've seen. Thank you.

  • @EmilyXieX
    @EmilyXieX 4 ปีที่แล้ว +91

    Loved how clear and minimalist your animations and explanations were--really allowed me to focus on understanding the high-level intuition around RNNs. Thanks so much.

    • @Usumgallu
      @Usumgallu 3 ปีที่แล้ว

      Yeah, finally a video that does not start with the useless "Hello! So basically [insert a two page long formal description that I'm not going to explain]" :D

  • @pranavbhagwat1734
    @pranavbhagwat1734 2 ปีที่แล้ว +1

    Just the right amount of jargon that I understood but didn't get bogged down by. I feel much more comfortable tackling the details of RNNs now so thank you for making this video!

  • @muhammadshoaibsikander2603
    @muhammadshoaibsikander2603 5 ปีที่แล้ว +1

    Its awesome. I was struggling for many hours to understand the concept of vanishing gradients but you made me understand just in 10 minutes. Thanks!

  • @theaihacker777
    @theaihacker777  5 ปีที่แล้ว +47

    Everyone, thanks for watching! I have plans to do a series of these on practical ML algorithms widely used in the industry. Subscribe for more!

  • @Alaska-mk4ok
    @Alaska-mk4ok 3 ปีที่แล้ว +1

    OMG I FINALLY UNDERSTAND HOW RNNS WORK OMG THANK YOU SO MUCH NO ONE HAS BEEN ABLE TO EXPLAIN THIS TO ME AS WELL AS YOU YOU ARE AMAZING I LEARNED THIGNS THAT I WAS NEVER ABLE TO LEARN THANKS TO YOU

  • @mohamedlabn3547
    @mohamedlabn3547 5 ปีที่แล้ว +130

    the best Video i have ever see about RNN thank u alot

    • @yongkailiu1448
      @yongkailiu1448 4 ปีที่แล้ว

      Mohamed Labn i don't think so. I guess he doesn't really know what's LSTM. Everything here is so stereotypical.

    • @sevenicolas2820
      @sevenicolas2820 3 ปีที่แล้ว

      He made a second video about LSTMs and GRUs

    • @trexmidnite
      @trexmidnite 2 ปีที่แล้ว

      Has plenty of saliva too!

  • @david0aloha
    @david0aloha 4 ปีที่แล้ว +1

    I really like your videos. You give reasonably in-depth explanations, very clearly, and in about 10 minutes.

  • @saurabh9446
    @saurabh9446 3 ปีที่แล้ว

    I've seen people saying that this is the best tutorial ever in each video. But this video is actually great video.

  • @ParulSharmaparul
    @ParulSharmaparul 5 ปีที่แล้ว +1

    Great Tutorial ! Thank you so much. I came to RNN's tutorial after going through LSTM and GRU tutorial only to understand why does vanishing gradient occur. I could understand it really well. It's very helpful. Please make more such videos. Big Help!

  • @tellyrotsyourbrain
    @tellyrotsyourbrain 4 ปีที่แล้ว +1

    Very clear explanation of what had previously been something of a mystery. Excellent! Thank you!

  • @shubhamk53
    @shubhamk53 5 ปีที่แล้ว +1

    finally, my vanishing gradient concept is cleared. A big thank you. Keep up the good work. You have definitely added one more subscriber.

  • @jafetsierra1875
    @jafetsierra1875 2 ปีที่แล้ว

    This is the best and simplest explanation i've found about RNN's by far. Thank you man.

  • @abhigyandatta2008
    @abhigyandatta2008 ปีที่แล้ว

    RNNs can be intimidating for beginners. The way you introduced them are exceptional. Thanks for the video.

  • @rachelthebear5064
    @rachelthebear5064 3 ปีที่แล้ว +2

    Honestly really great explanation, as a art major, I think I at least understood the mechanism for my big data class now, thanks!

  • @sean...
    @sean... 5 ปีที่แล้ว

    This was excellent, I suddenly understand the entire work flow and why LSTM was selected in my case study of text generation.

  • @johnr3936
    @johnr3936 4 ปีที่แล้ว +1

    You are incredibly informative while staying concise. Wonderful video!

  • @seanmci8149
    @seanmci8149 3 ปีที่แล้ว

    As someone new to RNNs this explanation was very clear. Thank you.

  • @sytekd00d
    @sytekd00d 5 ปีที่แล้ว

    Yo dude! I finally get it! Thank you so much for your videos. They are amazing. I am more of a visual learner and your videos have helped tremendously. Please keep them coming.

  • @mehdiaraghi4457
    @mehdiaraghi4457 4 ปีที่แล้ว +1

    Clear and completely understandable. like that especially when you showed with the code.

  • @kareenamulchandani3356
    @kareenamulchandani3356 2 ปีที่แล้ว +1

    I really liked how simple this video was. I am studying BPharm and interested in Computer science. But everything seems like greek and latin. This is so well explained and me being from biology background could understand.

  • @acidtears
    @acidtears 4 ปีที่แล้ว

    More please! You're great at talking and conveying information!

  • @hiral2cool
    @hiral2cool 5 ปีที่แล้ว +8

    this is marvelous creation till now in the video lectures. Completely understood the basic concepts with very cool visualization. Great Man. Keep it up. Want more like this.

    • @theaihacker777
      @theaihacker777  5 ปีที่แล้ว +1

      Thanks for the kind words :). More to come!

  • @lucaknobloch7175
    @lucaknobloch7175 4 ปีที่แล้ว

    A pretty good video to get an intuition of RNN, thank you for illustrating it in that way

  • @alanmacdonald2277
    @alanmacdonald2277 ปีที่แล้ว +2

    I found this to be incredibly helpful. Very well articulated and the visual representations are great. Thank you.

  • @goodmusic284
    @goodmusic284 ปีที่แล้ว

    This is the best explanation of RNNs I have seen on TH-cam!

  • @faridel-aouadi1776
    @faridel-aouadi1776 4 ปีที่แล้ว

    Great work Mikael, really well illustrated and explained!

  • @thevivekmathema
    @thevivekmathema 4 ปีที่แล้ว

    This is the best quick exampels i have ever seen

  • @kannankalidasan
    @kannankalidasan 4 ปีที่แล้ว

    the best video about sequence models. I become a big fan of you.
    After a few gems like Luis Serrano and 3B1B, you are next who explained the hard concepts in a simple way with a lot of fun. Thank you again.

  • @yalinbahadir
    @yalinbahadir 2 ปีที่แล้ว

    no perfect explanation exists
    except what you did. Thank you lot!

  • @manmohanrathi6283
    @manmohanrathi6283 3 ปีที่แล้ว

    WOW, i can understand the math once i understand the intuition which you explained very well brother!! I need to give a presentation on this tomorrow and you really saved me!! Bless you ;)

  • @man041986
    @man041986 4 ปีที่แล้ว

    THE BEST VIDEO ever about RNN. Thanks

  • @mrobjectoriented
    @mrobjectoriented 4 ปีที่แล้ว

    This made RNNs so clear! Thanks!

  • @benjaminw2194
    @benjaminw2194 2 ปีที่แล้ว

    Super helpful & enjoyable. I like the videos you make showing how to do a project like building a speech recognizer. Can you do more projects? I like the way you break down the whole process into pieces too. It really helps with knowing the steps and understanding the steps makes it easier to extrapolate the process to other projects.

  • @kazenokize2
    @kazenokize2 3 ปีที่แล้ว

    your explained the vanishing gradient problem so much better than the course I'm taking, THANK

  • @magicofmountshasta8330
    @magicofmountshasta8330 ปีที่แล้ว

    Probably the best explanatory video about RNNs
    that clicked for me :) Thanks!

  • @stevendeverteuil7620
    @stevendeverteuil7620 ปีที่แล้ว

    Explained better than my PhD professor, you saved me before RNN hw and final exam!

  • @Rrdd725
    @Rrdd725 3 ปีที่แล้ว

    Best explanation on RNNs on youtube! Thank you very much!

  • @ragequilt_
    @ragequilt_ 4 ปีที่แล้ว +7

    This is, without doubt, the best quick explanation on RNN's I've seen so far.

  • @sidhumega
    @sidhumega 4 ปีที่แล้ว

    Thanks for such great illustrations. This video serves as a great source for building intuition of RNN which otherwise requires lot of time and effort.

  • @IMateme
    @IMateme 4 ปีที่แล้ว

    Please keep going, You are a master in explaining.... don't stop

  • @markuskreutz4218
    @markuskreutz4218 5 ปีที่แล้ว +1

    Holy sh**, this video was fantastic, because it actually explains the real application of RNN, namely being able to process a sequence of arbitrary length instead of a fixed length sequence, which could be also input in a normal NN from my understanding. Also, the part about short-term-memory and back propagation problems was really great.

  • @ikgjazz
    @ikgjazz 11 หลายเดือนก่อน

    Great Tutorial Michael. Extremely clear and easy to understand.

  • @zukofire6424
    @zukofire6424 ปีที่แล้ว

    Thanks for this! I came out of my class with a very very blurry idea what RNN were, it's a lot clearer now! :)

  • @rohandeshmukh6103
    @rohandeshmukh6103 3 ปีที่แล้ว +1

    Best Explanation of RNN EVER !!!!!!!

  • @pavangupta6112
    @pavangupta6112 6 หลายเดือนก่อน

    Awesome explanation. Liked the intuition aspect of explaining RNN. Keep the great work going!

  • @fengwu9683
    @fengwu9683 5 ปีที่แล้ว +4

    pretty good video, hope to see more!!!

  • @davidlanigan4570
    @davidlanigan4570 4 ปีที่แล้ว +1

    The is absolutely fantastic and extremely helpful. Thank you.

  • @karolinaangelova6347
    @karolinaangelova6347 3 ปีที่แล้ว

    The best explanation about RNN, thank you so much!

  • @ahmedhany5037
    @ahmedhany5037 5 ปีที่แล้ว +2

    Awesome video keep it up man !! Definitely great video ! I like how you explained in a really intuitive way !

  • @valentindoring5105
    @valentindoring5105 2 ปีที่แล้ว

    this video made me finally understand how RNNs work. Thank you so much!!

  • @amilamuthunayake810
    @amilamuthunayake810 5 ปีที่แล้ว

    The best explanation so far. Hope to see videos on time series predictions.

  • @BenStoneking
    @BenStoneking 3 ปีที่แล้ว

    Great video! This is very helpful for my machine learning course project. I'm researching how to make an NN that can compose melodies so your video about RNN's was a great primer!

  • @tuanvutrinh2252
    @tuanvutrinh2252 3 ปีที่แล้ว

    the best video about RNN i have ever seen

  • @bayesianlee6447
    @bayesianlee6447 5 ปีที่แล้ว

    best resource on RNN ever on any medium.

  • @contarini9
    @contarini9 4 ปีที่แล้ว

    best explanation about RNN, amazing animations

  • @pimmelfish1
    @pimmelfish1 5 ปีที่แล้ว

    Thank you for this vid. You ilustrated the concept nice and clear.

  • @brindagurusamy7543
    @brindagurusamy7543 4 ปีที่แล้ว

    This is an amazing video and very succinctly explained RNN's!

  • @jayhu6075
    @jayhu6075 ปีที่แล้ว

    What a great explanation about this topic. Hopefully more from this stuff so as LLM. Many thanks.

  • @hcv1648
    @hcv1648 3 ปีที่แล้ว

    thanks.. finally, I am able to make sense after spending so much of time with RNN.

  • @gamagambogam
    @gamagambogam 3 ปีที่แล้ว +1

    Your explanation is on point dude! Please make more explanation video about neural network architecture!

  • @anipacify1163
    @anipacify1163 4 หลายเดือนก่อน

    Light bulb moment indeed . Good explanation. Many professors themselves are bad at explaining this topic. the video is structured well too . Love this short but amazing tutorial

  • @envy6886
    @envy6886 5 ปีที่แล้ว +2

    Thank you so much for your excellent work.

  • @sahajbedi9582
    @sahajbedi9582 5 ปีที่แล้ว

    Excellent explanation! Looking forward to more videos!

  • @mykhailo_chaus
    @mykhailo_chaus 2 ปีที่แล้ว

    Nice video, even 3 years later, in time of transformers. This gave great intuition about basic architecture, though more information about stacked RNNs layers would be great.

  • @velibor1
    @velibor1 11 หลายเดือนก่อน

    you nailed it, best description ever

  • @neespion1131
    @neespion1131 3 ปีที่แล้ว

    Yeaaahhhhhh! I got the light bub moment! Absolutely Amazing

  • @silviaschmid4659
    @silviaschmid4659 3 ปีที่แล้ว

    compliments!! explained clear and simple! I would like to learn more in detail about NLP, if you please make more! Thanks a lot!!

  • @jingchang55
    @jingchang55 4 ปีที่แล้ว

    Awesome video that helps me to grasp the RNN concept immediately. Please make more videos on AI. Thank you!

  • @MuTcyXuDe
    @MuTcyXuDe 4 ปีที่แล้ว

    Dude thank you a lot. I watched LOTS of videos and only yours gives this aha! moment! Thank you a lot again.

  • @chnoco
    @chnoco 4 ปีที่แล้ว

    Very useful for my final exam. Thank you!

  • @umessi10
    @umessi10 4 ปีที่แล้ว

    You are incredible at teaching! Thank you so much

  • @AhmedGadd
    @AhmedGadd 4 ปีที่แล้ว

    So helpful to get the idea of RNN and the difference to LSTM.

  • @eckotan8523
    @eckotan8523 5 ปีที่แล้ว

    The best videos about RNN!

  • @darrenwastestime
    @darrenwastestime 5 ปีที่แล้ว +5

    Great video! Would love to see LSTM and GRU

  • @sanjanareddy
    @sanjanareddy 4 ปีที่แล้ว

    Very well explained and the illustrations are amazing!

  • @ashishbhong5901
    @ashishbhong5901 18 วันที่ผ่านมา

    it was not just help full but amazing, loved it.

  • @user-ri7uz9il1v
    @user-ri7uz9il1v 3 ปีที่แล้ว

    Extremely helpful ! two track using visualization and logical coding helped me better understanding

  • @writetohorace
    @writetohorace 5 ปีที่แล้ว

    Great video. Thanks for putting this together. Love your work!

  • @SravanKumar-jt1ot
    @SravanKumar-jt1ot 5 ปีที่แล้ว

    Really, its a great explanation. Thanks for your video.

  • @fahdciwan8709
    @fahdciwan8709 4 ปีที่แล้ว +1

    was this helpful??? bro, u made me understand RNN crystal clear in 10 mins. Thank you!!!

  • @ammarazlan2919
    @ammarazlan2919 5 ปีที่แล้ว

    Thank you for a great explanation. It's really helpful.

  • @chandabcd
    @chandabcd 3 ปีที่แล้ว

    This tutorial is priceless!!! Thank you so much

  • @gkutube12
    @gkutube12 5 ปีที่แล้ว

    Thank you -- this was excellent!

  • @AnujTiwari
    @AnujTiwari 4 ปีที่แล้ว

    this is what is teaching .. great man you are the real teacher .. thanks a lot ... wait for more videos ...

  • @wesNeill
    @wesNeill 3 ปีที่แล้ว

    Excellent video on the intuition behind RNNs! Subscribed!

  • @neelagarwal2599
    @neelagarwal2599 6 หลายเดือนก่อน

    super cool - simple, easy and crisp!! Thanks

  • @user-ri3zy5pl9u
    @user-ri3zy5pl9u 3 ปีที่แล้ว

    The best video about RNNs

  • @waltdesignxp
    @waltdesignxp 7 หลายเดือนก่อน

    still so relevant! thank you!!!

  • @kakolisen16
    @kakolisen16 4 ปีที่แล้ว +1

    Very good and illustrative starter on RNN

  • @antran7806
    @antran7806 4 ปีที่แล้ว +1

    Great explanation on RNN. Thank you! May I ask what software did you use to create the animations?

  • @borispapic9510
    @borispapic9510 5 ปีที่แล้ว

    Good job bud, helped me

  • @coolest4101
    @coolest4101 4 ปีที่แล้ว

    This is really helpful! Thank you!!

  • @garvit1748
    @garvit1748 4 ปีที่แล้ว

    It's really helpful man, thanks for this :-)

  • @boredeggyolk7969
    @boredeggyolk7969 3 ปีที่แล้ว

    jesus christ i've watch so many youtube video and this is. Thisssss. i finally get it. Thank you so much TT-TT

  • @sachinkun21
    @sachinkun21 3 ปีที่แล้ว +1

    Great explanation! I have a question, what happens to the intermediate outputs.
    For example, output at t_0 i.e 'what'. Are they used for anything such as calculating loss such that 'time(next word in sequence)'-'output(at t_0)' in case of next word generator or final output Intent in case of Chatbot?

  • @lol6434
    @lol6434 4 ปีที่แล้ว

    Amazing explanation. Thank you.

  • @ruman2494
    @ruman2494 4 ปีที่แล้ว

    No words....Very well explained..! thank you! Add other videos on CNN.