- 4
- 36 176
Sam Levey
เข้าร่วมเมื่อ 24 ก.พ. 2015
The Matrix Transpose: Visual Intuition
Let's look at what the transpose of a matrix means intuitively. We'll understand how the transpose of a matrix is needed for trying to find pairs of vectors that have the same dot product before and after some linear transformation. We'll also use the Singular Value Decomposition to get a better geometric intuition for how these transformations appear geometrically. #linearalgebra #transpose #svd #SoMEpi
Correction: Around 13:20, when I say that Sigma-transpose = Sigma, this is only true if A (and therefore Sigma) are square matrices.
Prerequisites: you should already understand how matrices are linear transformations, matrix inverses and the identity matrix, and vector dot products. Knowing about the Singular Value Decomposition would help too, but isn't strictly required.
Some good background videos are the Essence of Linear Algebra series by 3Blue1Brown, especially chapters 3 and 9: th-cam.com/play/PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab.html
Chapters:
0:00 Introduction
0:48 Prerequisites
1:19 How to Take the Transpose
1:50 Properties of the Transpose
3:56 Motivating Question
4:56 Linear Transformations Do Not Necessarily Preserve the Dot Product
6:21 Linear Transformations and Dot Products, Visually
7:04 How Can We Preserve the Dot Product?
8:30 Preserved Dot Products, Visually
9:41 Orthogonal Matrices
11:10 Singular Value Decomposition Introduction
12:39 Using the SVD on the Inverse-Transpose
15:28 Additional Examples with the SVD
16:31 What if A is not invertible?
18:25 Main Equation
19:13 Visualization Revisited
19:43 Transpose vs. Inverse
20:38 SVD of the Inverse and Transpose
21:39 SVD of Each Matrix, Visualized
23:34 Symmetric Matrices
24:30 Summary
Useful links for learning more:
en.wikipedia.org/wiki/Transpose
th-cam.com/video/g4ecBFmvAYU/w-d-xo.htmlsi=j9HjN8ZvJH3Hola2
th-cam.com/video/uGuZ-2jAigs/w-d-xo.html
th-cam.com/video/QpNogWizbpw/w-d-xo.html
th-cam.com/video/YCs_1qYxs2Q/w-d-xo.html
th-cam.com/video/92SYFdjYsfQ/w-d-xo.html
th-cam.com/play/PLWhu9osGd2dB9uMG5gKBARmk73oHUUQZS.html
th-cam.com/video/Oshh9F-Rc3c/w-d-xo.html
th-cam.com/video/NpsfSR1Ymdo/w-d-xo.html
th-cam.com/video/0fbeZr8aGfk/w-d-xo.html
th-cam.com/video/aG5tFA8GJ78/w-d-xo.htmlsi=UHx4LoCz_7IRmk8B
Music by Karl Casey @ White Bat Audio: karlcasey.bandcamp.com/
Made with Manim: www.manim.community/. The source code can be found at github.com/slevey087/transpose-video
Tips are appreciated! Tip me at: ko-fi.com/slevey
Correction: Around 13:20, when I say that Sigma-transpose = Sigma, this is only true if A (and therefore Sigma) are square matrices.
Prerequisites: you should already understand how matrices are linear transformations, matrix inverses and the identity matrix, and vector dot products. Knowing about the Singular Value Decomposition would help too, but isn't strictly required.
Some good background videos are the Essence of Linear Algebra series by 3Blue1Brown, especially chapters 3 and 9: th-cam.com/play/PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab.html
Chapters:
0:00 Introduction
0:48 Prerequisites
1:19 How to Take the Transpose
1:50 Properties of the Transpose
3:56 Motivating Question
4:56 Linear Transformations Do Not Necessarily Preserve the Dot Product
6:21 Linear Transformations and Dot Products, Visually
7:04 How Can We Preserve the Dot Product?
8:30 Preserved Dot Products, Visually
9:41 Orthogonal Matrices
11:10 Singular Value Decomposition Introduction
12:39 Using the SVD on the Inverse-Transpose
15:28 Additional Examples with the SVD
16:31 What if A is not invertible?
18:25 Main Equation
19:13 Visualization Revisited
19:43 Transpose vs. Inverse
20:38 SVD of the Inverse and Transpose
21:39 SVD of Each Matrix, Visualized
23:34 Symmetric Matrices
24:30 Summary
Useful links for learning more:
en.wikipedia.org/wiki/Transpose
th-cam.com/video/g4ecBFmvAYU/w-d-xo.htmlsi=j9HjN8ZvJH3Hola2
th-cam.com/video/uGuZ-2jAigs/w-d-xo.html
th-cam.com/video/QpNogWizbpw/w-d-xo.html
th-cam.com/video/YCs_1qYxs2Q/w-d-xo.html
th-cam.com/video/92SYFdjYsfQ/w-d-xo.html
th-cam.com/play/PLWhu9osGd2dB9uMG5gKBARmk73oHUUQZS.html
th-cam.com/video/Oshh9F-Rc3c/w-d-xo.html
th-cam.com/video/NpsfSR1Ymdo/w-d-xo.html
th-cam.com/video/0fbeZr8aGfk/w-d-xo.html
th-cam.com/video/aG5tFA8GJ78/w-d-xo.htmlsi=UHx4LoCz_7IRmk8B
Music by Karl Casey @ White Bat Audio: karlcasey.bandcamp.com/
Made with Manim: www.manim.community/. The source code can be found at github.com/slevey087/transpose-video
Tips are appreciated! Tip me at: ko-fi.com/slevey
มุมมอง: 32 652
วีดีโอ
Mixing "Gay or European" - Legally Blonde the Musical
มุมมอง 187ปีที่แล้ว
Mixing line-by-line audio for Legally Blonde the Musical, at the Starlight Theatre in Kansas City on 7/13/23. In line-by-line mixing, the goal is to have the minimum number of microphones on at any given time, often just the microphone on the person who's currently speaking. The faders in the center of the console are assigned to various performers (and snapshots change which people are on whic...
Modeling Monopoly Money - 2nd International MMT Conference
มุมมอง 4443 ปีที่แล้ว
Briefly explaining the monopoly money (or "dual-price") model as found here: www.levyinstitute.org/pubs/wp_992.pdf). These models demonstrate two key MMT concepts: the state as the source of the price level and unemployment. The first part of the paper/presentation asks what would happen to the private price level if the state held hard to the prices it pays when it spends. The result: the priv...
Keep the good work up! Amazing video! Thanks for sharing! My only suggestion would be lowering just a tiny bit the music in the background. The rest is amazing!
Beautiful!!!
Thankyou for making this great masterpiece! Absolutely mind blowing to see how delightful linear algebra is :D
This is a really clear and good explanation. The introduction of the transpose in basic courses is deceptively easy. Even a child could understand the definition of switching rows and columns. This hides the fact that the transpose is actually one of the deepest matrix operations, mathematically, you encounter in the first courses. You just don't typically realize it.
You made that transpose video for fun ? Legendary.
I am going to watch this again ❤
Is there a real-life situation when we want to find the M transformation that preserve the dot product? ... Super neat exploration and I'm trying to understand better. Thank you!
Simply amazing, it is by far the best video I've found about this topic.
The easiest looking matrix operation has the most difficult geometric intuition. A very good explanation indeed! Thank you
from my heart , i would like to say thank you , with high appreciate for all of your videos, i believe your video are helping alot of student are struggling with LA.😊😊😊
5:02 vTw is a 1 by 1 matrix and the dot product is a number so these don't seem to be the same thing
A 1×1 matrix is considered the same is its single element.
This is the most underrated video ever! It should have the same amount of views as 3Blue1Brown has
Truly a superb explanation!!
Wow, finally someone that explained it well! magnificant!
This is amazing! When you discussed how the dot product of x and v retains by applying different (but almost similar) matrix transformations in 15:11, a nice way to look at it also is through the formula of the dot product (x*v) = ||x|| ||v|| cos\theta. Since x and v are essentially applied with the same orthogonal matrices from the decomposition, theta will be unchanged. But scaling x using Sigma and scaling v using the Sigma inverse will tell that ||x|| is scaled "up" as much as ||v|| is scaled "down" and so the dot product is retained. regardless, great visual intuition! I'm loving the current YT community that teaches mathematics.
Perfect explanition doesn't exsi...
I wish you had shown what A transpose does to the output of A. I get that it isn't clean, but its also what we came here for.
Awesome -- thanks! Do you share your Manim (presumably) code on Github for other presenters to learn from?
+1 sub
didn't quite get it, i'll be referring back to this video a bunch of times in the future throughout my engineering degree. I don't even have to know this yet, but I find it extremely helpful to understand concepts instead of just memorizing the exercises that one must solve in order to pass the test. Thank you for putting this knowledge online <3
Thank you so much for this!
鼠疫
累人
So if I understand correctly, is a transpose sort of like an "inversion" for the reflection of Ax over the line y=x, which brings you back to x?
Man you f****ing Rock!!! 😮 the best video on the subject! And i have watched many…. Top notch explanation and video
11:48 Thank you.
Great explanation!
I came here from MIT ocw and this video is too good!!! Thank you.
Thank you.
Dunno what your occupation is but you clearly have an educator/ideas sharing talent.
Thank you! I am indeed an educator :)
Bro casually explained SVD in 20 seconds better than most can do while covering a different topic.
Thanks!!
was doing some graphics programming and this clears things up. thank you!
hi there, fellow math educator :) this is my first time watching your channel. great visuals and explanations! my only criticism is that the music was a bit loud and distracting. at the very least i'd say reduce the music volume (or do away with it), and if you keep music, i'd choose music with much lower tempo. the choice for this video felt a bit too 'fast' personally. but otherwise, great content! i'm looking forward to future videos. best of luck :)
This video is so beautiful !
Such an amazing video. I'm shocked that you only have 924 subscribers. You explained this so well, and so elegantly, it really is truly amazing. Linear algebra is so beautiful. Thank you.
Thanks!
Thanks man i discovered retrosynthwave!! Have an icecream from my side!
Excellent exposition!!!
Can yu explain what is cofactor geometrically?..❤
Bro you're 2nd 3B1B! Keep going✨🔥
This was very well done!
As a graduate student in physics, this was very helpful in grounding the definition of unitary transformations, thanks so much and beautiful video!
I'd like to see what the visual intuition would be on unitary transformations as orthogonal matrices can be generalized to the complex numbers through unitary matrices.
underrated af
I remember asking my linear algebra teacher this exact thing and he just looked at me weird and said, "you just change rows and column". I stopped asking him stuff after that.
same with my professor. I'm so glad I came across this and 3b1b videos, they make me realize just how beautiful all of this is
You are going to blow up in millions very quickly...mark my words!! Commenting here to get atleast thousands of likes from million views😉😁
I don't really get the premise of the explanation. Wouldn't there be infinitely many new vectors v bar that satisfy x dot v = x bar dot v bar with x bar = A x and thus infinetly many matrices to get us there? What is so special about the transpose of the inverse of A then? It does of course satisfy the equation, but so could infinetly many other matrices, no?
For a given fixed x that is true, but if you want to use the same matrices for any arbitrary x and v, then you have to use the A and A-inverse-transpose.
@@samlevey3263 Ok, that makes sense. Thanks for the response!
Wowwwwwwwww22❤❤❤❤❤❤
Beautiful 😻
Is the choice of x and v as names for the vectors instead of u and v a deliberate choise so that students don't mess up because u and v are very similarly written ? If yes, this is another proof of the care you put in the video who is very good
I like your video as i often get confused while watching other linearly algebra videos. The recap part in the beginning is very neat.
Thank you for the video. Very clear explanation of transpose and SVD. I am motivated by applications… The SVD is so insanely powerful! Could you make a video that illustrates how the unitary rotation/scale/rotation of the SVD solve a problem? That would be so helpful! Thank you for sharing.