SVD Visualized, Singular Value Decomposition explained | SEE Matrix , Chapter 3

แชร์
ฝัง
  • เผยแพร่เมื่อ 23 พ.ย. 2024

ความคิดเห็น • 461

  • @bananalord8575
    @bananalord8575 9 หลายเดือนก่อน +420

    The whole youtube math visualization comunioty needs to thank 3 blue 1 brown for inspiring a new generation of gifted people like yourself

    • @CraszyAsce
      @CraszyAsce 5 หลายเดือนก่อน +1

      100%

    • @Dom-zy1qy
      @Dom-zy1qy 2 หลายเดือนก่อน +5

      And for open sourcing his library for making these visualizations. (And the community who forked it, and now maintains it)

    • @Physics22KU
      @Physics22KU 2 หลายเดือนก่อน +1

      @@Dom-zy1qy Manim library?

  • @zenicv
    @zenicv ปีที่แล้ว +91

    I never thought in my life that I'd watch a linear algebra matrix video with the same interest as the real Matrix movie

    • @RasberryPhi
      @RasberryPhi 6 หลายเดือนก่อน

      so true dude

    • @PriyanshuSinhasc
      @PriyanshuSinhasc หลายเดือนก่อน +1

      Real matrix movie was cringe

    • @artophile7777
      @artophile7777 8 ชั่วโมงที่ผ่านมา

      ​@@PriyanshuSinhasc ok

  • @molackanil4115
    @molackanil4115 ปีที่แล้ว +127

    WOW! You have an extremely rare gift. I'm at a loss for words. I love 3Blue1Brown and Prof. Strang. But you just took pedagogy to a whole different level. This is unbelievable!
    I watched all four videos in one sitting. I understood things I've tried to understand for years.
    I'm not kidding I have tears dripping down my cheeks right now.
    I hope you make more videos.
    Thank you thank you thank you!
    I never leave comments.

    • @AamirAliDrigh
      @AamirAliDrigh 7 หลายเดือนก่อน +5

      meanwhile gibert strang took weeks to teach this. he has done it in 20 mins. unbelievable pedagogical skills man.

  • @marcelogranja
    @marcelogranja ปีที่แล้ว +37

    After 10 years of struggle I can finally understand SVD. Congratulations Sir!

  • @suman14san
    @suman14san 5 หลายเดือนก่อน +18

    People like you will have a special place in heaven ❤

  • @peilanhsu
    @peilanhsu 8 หลายเดือนก่อน +4

    Awesome video thank you! Can't wait for your PCA video!

  • @johnstuder847
    @johnstuder847 2 ปีที่แล้ว +178

    These 4 videos have been a real treat. You have a gift for simplifying complex ideas. Hope you find time to continue making videos. As you said with one of the video quotes - this animation wasn’t even possible until recently. Every one I talked to that learned Linear Algebra before TH-cam thinks of it as a boring abstract, useless (!) area of math. It’s wonderful to see it come to life by generous educators like you. Please continue to contribute as time allows. I would love to see your take on the General Stokes Theorem and metric tensors! Is there a way to contact you directly?

    • @visualkernel
      @visualkernel  2 ปีที่แล้ว +18

      Hi John, thank you for your patience sitting through all 4 videos, I actually believe most people who watched SVD never even know about the existence of the previous chapters. I am actually not a math major student, so I will defer your question about General Stokes Theorem to this channel: th-cam.com/video/0UvNF_cfBJ4/w-d-xo.html. You can contact me from my channel email: vizkernel@gmail.com .

    • @stefanfarier7384
      @stefanfarier7384 ปีที่แล้ว +3

      Higher level Math is often written in a bland and uninteresting way when it is far from that. You Sir, have brought life to the topic. Blessings!

    • @exoticcoder5365
      @exoticcoder5365 ปีที่แล้ว +1

      @@visualkernel This gorgeous episode made me realise there are previous chapters to it, I will definitely watch all of them despite I already learnt those topics but I am still interested in your versions, I know they would still bring me some new insights !

    • @karthikrajeshwaran1997
      @karthikrajeshwaran1997 9 หลายเดือนก่อน

      Bro u r just amazing. This is outstanding.

  • @preetysingh7672
    @preetysingh7672 8 หลายเดือนก่อน +4

    After searching the entire Internet for whole day, I bumped into this series which gave me clear visual interpretation of what and why of SVD to understand PCA, free of cost far better than paid ones. Without this, these algorithms are just numerical operations making no sense to any individual not expert in Algebra and all.
    You are a pure boon and bliss to learners like us. Such beautiful work are another dimension to humanity. Thanks a lot..!!🙂🙏

  • @htetaung04
    @htetaung04 2 หลายเดือนก่อน +2

    I just came across this video. Your explanation is absolutely amazing. Then I go to your channel and realise you haven't been on YT for 2 years. I wish you come back!

  • @mathemaniac
    @mathemaniac 2 ปีที่แล้ว +25

    Came here from the peer review!
    This is very well animated and well motivated in the beginning. A hard agree on that matrices can have wildly different meaning in different contexts. Just a bit of nitpick at the end - I don't think Fourier transform works for ALL functions, just sufficiently "nice" functions (while SVD really works for ALL matrices). I understand the comparison being that they are decomposition of some "complicated" objects into "simpler" objects to deal with, though. But anyway, this is a very good video!

    • @visualkernel
      @visualkernel  2 ปีที่แล้ว +10

      DAMN !!! Mathemaniac is peer reviewing my video ?! What a honor ! I think you are right, fourier transform really doesn't work on ALL function. By the way, I think your Quintic video is going to win this year, it's so impressive.

  • @francoisvictor8
    @francoisvictor8 ปีที่แล้ว +3

    After many days in the desert of linear algebra, thank you for teaching us how to ride those horses and helping us understand their names.

  • @markclintworth6134
    @markclintworth6134 7 หลายเดือนก่อน +2

    A huge thanks. You deserve the Oscar for "Best Matrix Algebra Teacher" for this (together with Chapter 1 & 2)! ..... a real achievement in describing a difficult set of concepts in such an intuitive visual manner. Congratulations!!

  • @MrRykooo100
    @MrRykooo100 2 ปีที่แล้ว +7

    my god dude, you are incredibly gifted. I didn't have to squint my eyes to understand everything. Very articulate and powerfully simple. Thank you.

  • @basedland
    @basedland ปีที่แล้ว +3

    Just went over all of these for my data science class, this deserves a million views. Thank you sir.

  • @vcubingx
    @vcubingx 2 ปีที่แล้ว +67

    This was super well done. Great job!!!

    • @visualkernel
      @visualkernel  2 ปีที่แล้ว +7

      Thank you Vivek ! A very special "first comment" my video got here.

  • @saleemun8842
    @saleemun8842 ปีที่แล้ว +27

    This is by far the most brilliant and entertaining videos for understanding linear algebra. You've done a very great job man! Thank you so much.

  • @alsthania826
    @alsthania826 8 หลายเดือนก่อน +1

    I see now... Thank you very much, been struggling with doing PCA using this but now I know. And I'll be waiting for the video of PCA!

  • @cs02421
    @cs02421 ปีที่แล้ว +3

    I am gonna remember these concepts for the rest of my life - all because your videos provided an intuitive insight which cannot be any simpler. Hats off! SVD always scared me, but far less now. :)

  • @rolandocortez2405
    @rolandocortez2405 6 หลายเดือนก่อน +10

    I can't wait for the principal component analysis video you promised 👀

  • @ai_station_fa
    @ai_station_fa ปีที่แล้ว +6

    These videos are, in my opinion, best explanations ever to linear algebra and matrix decompositions. I have watched tons of videos and read two books. None of which gave me intuition about linear algebra, only formulas and I couldn't get my way out of it.
    Thanks. Please, keep making videos like this.

  • @dmitryr9613
    @dmitryr9613 3 หลายเดือนก่อน +1

    Wow! This takes 3B1B's style and does it better. I've always struggled to actually understand the intuition behind info presented in 3Blue1Brown's videos, but I was able to easily follow this video without even watching the first two parts. Granted, I have some background knowledge in symmetric and orthogonal matrices, transpose, etc. But this video took the things I could relate to from linear algebra class and combined them in a way that just... made sense. Bravissimo!
    the AoT jukebox music was also a nice touch:)

  • @RahulSharma-ht2xz
    @RahulSharma-ht2xz 2 ปีที่แล้ว +1

    totally love it, I learnt 10X time more after watching this video than reading my book 10 times.

  • @massimoc7494
    @massimoc7494 2 ปีที่แล้ว +1

    After being bogged down with math for a while a visualization proof helps understanding very much, thank you

  • @lyricass7810
    @lyricass7810 16 วันที่ผ่านมา +1

    I just fuc**** love this channel, this video, and its creator...❤️‍🔥, thank you so much for the svd intuion Anna(in my language brother❤️).
    I just love all the maths community ❤️‍🔥.

  • @pardonjoon8835
    @pardonjoon8835 2 วันที่ผ่านมา

    omg! the made in abyss music in the background made me soooo happy! that's my favorite anime ever! thank you so much for everything, you're helping me pass my 18.06 exam tomorrow! you're the goat!

  • @danilocorreia5104
    @danilocorreia5104 ปีที่แล้ว

    These 4 videos enlightened me more than the past two weeks of machine learning class

  • @DanielaGonzalezdelaGarza
    @DanielaGonzalezdelaGarza ปีที่แล้ว +7

    Thank you for explaining complex ideas in such an intuitive way! It has been immensely helpful to me!

  • @RichJolly-e3z
    @RichJolly-e3z ปีที่แล้ว +1

    Beautiful. The comparison of the SVD to the Fourier Transform really cemented the ideas! Thanks.

  • @ej8eid23i38
    @ej8eid23i38 7 หลายเดือนก่อน +1

    The 4 videos and the Attack on Titan Ost during the visualization as the final part was perfect. Thank you sir

  • @RRRRRRRRRRRRRRR8964
    @RRRRRRRRRRRRRRR8964 ปีที่แล้ว +1

    it's great!!! most of time, I can only know how to calculate and remember theoroms in my class. After watching these videos, i finally get what im learning this semester!

  • @underfilho
    @underfilho หลายเดือนก่อน

    GREAT VIDEO!!! I'm studying this right now and we saw this as some way of change of basis in a way that the transformation be nicer, and also to do these things with approximation of images and to get the most important features of some data. It's great to have that way of geometric visualization too, and makes perfect sense with I have studied.

  • @skyward-r3k
    @skyward-r3k ปีที่แล้ว +2

    This is absolutely mind blowing. The way you can explain these concepts visually and intuitively is beautiful and clear. I should not be able to watch this for free

  • @HarveyLim-w5y
    @HarveyLim-w5y หลายเดือนก่อน

    Sir you are to be congratulated. I am always searching for an understanding of difficult mathematical concepts to be explained simply. You have done that in spades for this difficult concept of linear algebra. Your series of videos that lead up to your SVD explanation are pedagogical genius. Professor Gilbert Strang would be proud.

  • @guywac
    @guywac ปีที่แล้ว

    These videos are excellent. Very rare to see an explanation that reveals the intuitive and REAL meaning of these processes and not just a bunch of equations. The most important thing is to understand what concept.

  • @yashkokane4841
    @yashkokane4841 5 หลายเดือนก่อน

    Not everyday do I come across videos on youtube that blow my mind like this one did. Cannot thank you enough!

  • @prianshubhatia2759
    @prianshubhatia2759 ปีที่แล้ว +1

    This four part series should be part of every linear algebra curriculum!

  • @pengqianlu6824
    @pengqianlu6824 ปีที่แล้ว +1

    8:59, I can feel when you speaking the equation, you are as excited as performing Kamehameha accumulated on your hands for so long. Your video is awesome bro!

  • @firstkaransingh
    @firstkaransingh 2 ปีที่แล้ว +2

    This is terrific.... Extremely well explained a concept as complex as SVD. Thanks a lot.

  • @sokkawatertribe2252
    @sokkawatertribe2252 ปีที่แล้ว +1

    Absolutely beautiful my man! Brought me to tears. The most ingenious part was introducing the dimension eraser/adder. After that, everything was smooth as butter.

  • @JimmyMGhill27
    @JimmyMGhill27 6 หลายเดือนก่อน +11

    It's hard to pay attention when you recognize all the anime songs😂 good job either on SVD and sounds!

  • @shivc22
    @shivc22 ปีที่แล้ว +7

    Awesome work! This is probably the best explanation of SVD on TH-cam. Would be great if you created the PCA video

  • @mujibai
    @mujibai ปีที่แล้ว +1

    Come back and save more lives, man. Your videos have saved countless lives.

  • @usamasaddique7580
    @usamasaddique7580 ปีที่แล้ว +2

    Never seen such a detailed and great explanation of any topic. Excellent effort man. Keep teaching.

  • @sichangxu6209
    @sichangxu6209 3 หลายเดือนก่อน

    Your explanation of decomposition and svd is so impressive and effective to me. As you said, the insight you give from the video is so inspiring. Hope in future you can have the chance to finish this series. Thank you very much!

  • @yehiamoustafa9801
    @yehiamoustafa9801 ปีที่แล้ว

    These 4 vedios are the best at explaining the matrices and the SVD , thanks a lot for your great effort

  • @actualBIAS
    @actualBIAS ปีที่แล้ว +1

    Thank you for this amazing peace of work. I want to let you know that you helped me to understand this topic. This is by far the best explanation I 've seen here.

  • @axolotl_observer
    @axolotl_observer ปีที่แล้ว

    watching all your videos on SVD gave me a feeling of watching an amazing series. it ends where it needs, every chapter is closed and you feel like you want more yet you know it was a correct time to stop. such a bitter-sweet feeling. Thank you!

    • @visualkernel
      @visualkernel  ปีที่แล้ว

      Hope you had fun along the way !

  • @Jonathan_man
    @Jonathan_man 10 หลายเดือนก่อน

    Top range videos I've ever seen in my life, plz keep doing them. It really helps someone who is learning linear algebra. Thank you so much.

  • @HaritsElfahmi
    @HaritsElfahmi ปีที่แล้ว

    literally coming back here a few times just to rewatch this, awesome video

  • @3xor3y
    @3xor3y 10 หลายเดือนก่อน

    Just guessing, I'm not the only one here never had a good understanding of SVD before this video, even though I had used it several times before. Please keep up the good work.

  • @joarhussain6602
    @joarhussain6602 3 หลายเดือนก่อน

    You have no clue how much this has helped me understand not only svd but also lin alg as a whole. I wish i found your channel sooner. You're very underrated, keep up the great work!

  • @exoticcoder5365
    @exoticcoder5365 ปีที่แล้ว

    This video is gold, I have watched several videos about SVD, but this one explained the best

  • @stanees9657
    @stanees9657 ปีที่แล้ว

    You deserve to be remembered in my life.

  • @jonathanliu4201
    @jonathanliu4201 หลายเดือนก่อน

    These are fantastic videos. The intuition your animations instill is brilliant

  • @吳宥瑄-c3j
    @吳宥瑄-c3j 8 หลายเดือนก่อน +2

    "a video in the future" 🥹🥹🥹
    Please more videos!!!

  • @ChanniWalker
    @ChanniWalker 4 หลายเดือนก่อน +1

    Truly amazing video. Thank you very much.

  • @abhishh_ek
    @abhishh_ek 5 หลายเดือนก่อน +1

    Gahd damn this was cinematic. Loved the little details like the guitar strum starting from one note going to a full chord as you explained the completeness of SVD.

  • @OuailOucherif
    @OuailOucherif 5 หลายเดือนก่อน

    This video is a piece of art , just like the fancy world of math and linear algebra , thanks for the efforts !

  • @winnieyang4843
    @winnieyang4843 8 หลายเดือนก่อน

    It is a phenomenal video! Building mental image of math object is so important for learning math and yours is really the best for this topic! I will recommend to anyone who wants to learn SVD!

  • @nitika9769
    @nitika9769 9 หลายเดือนก่อน +1

    please put out the video explaining PCA and how it relates to eigen vectors, you are my only hope

  • @zilonghuang3377
    @zilonghuang3377 ปีที่แล้ว

    Come from another platform bilibili after watching a Chinese translated version. I have to say that this serie of video could be the best linear algebra visual interpretation. Thanks for delivering contents of such high quality.❤❤❤

  • @Teacute
    @Teacute 2 ปีที่แล้ว +2

    Super helpful, keep making more of these please 👌

  • @MrSaimahesh
    @MrSaimahesh ปีที่แล้ว +3

    I'm really enjoying the spawn of channels very similar to this and 3B1B. The animation style is something I missed during high school. I can also see that it's harder to make mistakes when you have and better fundamental understanding. Using this to solidify my understanding of my master's thesis.

    • @teaformulamaths
      @teaformulamaths ปีที่แล้ว

      I think the opposite about copying, I can praise innovation

  • @Marco-vp8wl
    @Marco-vp8wl ปีที่แล้ว

    Had SVD in controlsystems, and this video made me understand it so much deeper, thanks 👍

  • @westcoasthighway
    @westcoasthighway 10 หลายเดือนก่อน

    the visualization was very good and I just love the power and energy in your voice

  • @hydropage2855
    @hydropage2855 3 หลายเดือนก่อน +2

    WHERE is PCA. This is absolutely incredible. I need more. Please

  • @vedantgirnare9226
    @vedantgirnare9226 4 หลายเดือนก่อน +1

    Amazing set of videos man! I don't have words to describe it! This is what the internet is meant for.

  • @PRABHATHANUJAKOPPULA
    @PRABHATHANUJAKOPPULA 4 หลายเดือนก่อน

    This video is a saviour.Thank you so much for such wonderful visualization. Please please please do more videos @visualkernel. Waiting for PCA

  • @aldolunabueno2634
    @aldolunabueno2634 2 ปีที่แล้ว +2

    A masterpiece! It was very helpful and now I feel like I know something huge. Thank you!

  • @DJSturm1
    @DJSturm1 2 ปีที่แล้ว +1

    Great job, looking forward for new videos- this is first video about SVD that actually clarified my understanding about it. Thank you!

  • @kennybainbridge2473
    @kennybainbridge2473 ปีที่แล้ว +1

    This video series was fantastic. It does a great job explaining everything that leads up to the SVD. I tremendously look forward to any more videos from you. :)

  • @tanvirkaisar7245
    @tanvirkaisar7245 ปีที่แล้ว

    This is the best visualization I have ever seen on a plethora of topics in Linear Algebra. Thank you! Eagerly waiting for the next video from you.

  • @danf1380
    @danf1380 ปีที่แล้ว

    I was so confused with the SVD and your visulization really helps me understand!Thank you very much!

  • @Automan9
    @Automan9 11 หลายเดือนก่อน

    An absolute effing treat this seres has been. Youve explained SVD better than people who have written books about the subject. So gifted, thank you for sharing. Cant wait to see the next video promised 🤤

  • @suzum0978
    @suzum0978 4 หลายเดือนก่อน +2

    You are insanely good !

  • @TheJara123
    @TheJara123 11 หลายเดือนก่อน +1

    Wonderfully presented man..come back and give us more!!

  • @AamirAliDrigh
    @AamirAliDrigh 7 หลายเดือนก่อน

    meanwhile Gilbert Strang took weeks to teach this. you have done it in 17 mins. unbelievable pedagogical skills man. keep up the good work.

  • @YuanpuLi
    @YuanpuLi ปีที่แล้ว

    You are an amazing teacher making everything so easy to understand.

  • @asatorftw
    @asatorftw 7 หลายเดือนก่อน

    What a phantastic series. Truly appreciate your effort!

  • @user-k6c5u
    @user-k6c5u 6 หลายเดือนก่อน

    Great visualization of sequential roles of decomposed matrices!

  • @mulezen9167
    @mulezen9167 ปีที่แล้ว

    This video is pure gold. More people should see it.

  • @rhke6789
    @rhke6789 3 หลายเดือนก่อน

    So many ways to explain SVD, yet so many instructions/instructors are about mechanics of svd offering no intuition or insight. This is the first time I saw svd developed using insight and intuition. I watched videos 1-4, repeatedly and thoroughly enjoyed it and now I can remember everything because the steps getting to why svd works are all intuitive. I look forward, sir, to your PCA lessons, been 2 years. Please?

  • @karkaroff1617
    @karkaroff1617 2 ปีที่แล้ว

    dude just: 1. talked about something that i needed to learn; 2. put in Shingeki music; 3. put in VSAUCE MUSIC.
    You just gain one more sub my friend.

  • @DiamondSane
    @DiamondSane 2 ปีที่แล้ว +1

    Finally, a both useful and beautiful, among just beautiful some2 videos.

  • @user-rg3or4kj3k
    @user-rg3or4kj3k ปีที่แล้ว +3

    Absolutely brilliant! Very very good presentation, the editing, aesthetics and overall effort you put into these is phenomenal! Please please continue making them :)
    I was very demotivated to study for my final and this boosted my motivation a lot and made the entire course so much super intruiging. I now constantly think to myself, what does this really mean visually and it helps a lot! Thank you!

  • @rehelm3114
    @rehelm3114 10 หลายเดือนก่อน

    Best linear algebra content on youtube BY FAR. Thank you!!

  • @donatosilvestri6297
    @donatosilvestri6297 ปีที่แล้ว

    This is art, it has been an exciting journey through lienar algebra. I really appreciate your job, thanks a lot !!!

  • @rishabchoubey2900
    @rishabchoubey2900 6 หลายเดือนก่อน

    thank you so much. This video was very helpful as I have been studying System identification and understanding SVD helped a lot.

  • @gerardocastaneda2204
    @gerardocastaneda2204 2 ปีที่แล้ว +2

    Great videos and complement to 3B1B. Thanks!

  • @iqbalmaulana3888
    @iqbalmaulana3888 14 วันที่ผ่านมา

    Bro you are single handedly save my master degree. thanks

  • @michacukrowski5518
    @michacukrowski5518 ปีที่แล้ว

    13:25 is a gamechanger, thank you!

  • @rockapedra1130
    @rockapedra1130 ปีที่แล้ว

    Very good! You have the perfect balance of talk and graphics. Excellent work!
    I would love to see all those weird other factorizations (like triangular, Cholesky, blah blah) in your excellent visual demonstrations!

  • @Bolalexvalencia
    @Bolalexvalencia 2 ปีที่แล้ว +1

    This should have way more views. Waiting for the next ones. Excellent!

  • @rishabhgupta-he2wg
    @rishabhgupta-he2wg ปีที่แล้ว +1

    Man, this interpretation is divine level stuff. You are so good! Please make more such videos

  • @komalbagai9835
    @komalbagai9835 ปีที่แล้ว

    Great and super fun ways to learn these concepts. Your videos are life saver! It would be so great to have PCA explained as well. Thank you!

  • @AtanasNenov
    @AtanasNenov 11 หลายเดือนก่อน

    Prof. Strang would be proud, great work! Perhaps the one and only thing really lacking in his 18.06 course was the visual intuition behind all those transformations. You really can't give them justice on a black board only.

  • @remeris9061
    @remeris9061 ปีที่แล้ว

    Thank you kindly for this explanation and all work you've performed to make this material.

  • @josiah9524
    @josiah9524 ปีที่แล้ว

    This was very helpful for understanding SVD, thank you so much! I'd love to see more video's from your channel in the future.

  • @Nanorooms
    @Nanorooms 2 ปีที่แล้ว +2

    This is just magnificent…

  • @yusufnzm
    @yusufnzm 9 หลายเดือนก่อน

    Please continue doing videos man. Your teaching is great.