15. Projections onto Subspaces
ฝัง
- เผยแพร่เมื่อ 28 ส.ค. 2024
- MIT 18.06 Linear Algebra, Spring 2005
Instructor: Gilbert Strang
View the complete course: ocw.mit.edu/18-...
TH-cam Playlist: • MIT 18.06 Linear Algeb...
15. Projections onto Subspaces
License: Creative Commons BY-NC-SA
More information at ocw.mit.edu/terms
More courses at ocw.mit.edu
0:15 "...Let's make this lecture immortal"
NOW IS 2019
He did
2020 right now
Yeahhh, i like that i dea
yeaheheahea
after 9 years, it is immortal ,professor, it is immortal
I was thinking the same thing
After 11 years too :)
after 15 years too prof !
After 15 years
@@tino139 after 20 years. The lectures were filmed in 2000
I don't know if anyone else has noticed this, but the gradual shift into abstract concepts is done flawlessly by Professor Strang. In the first few lectures, really up until the lectures on bases, all of the methods Professor Strang uses to teach the subjects were concrete examples; very little was done with abstract definitions and arbitrary matrices. Over the last few lectures, Prof. Strang has made a gradual shift into abstractness which let's the mode of this sort of thinking sink in. Now, in this lecture, nothing is concrete and no numbers are ever used (until the end) and it feels effortless to understand! This man is a genius when it comes to math education. Thanks so much MIT and Prof. Strang for the amazing experience!
The lectures are beyond fantastic no doubt, but I really feel he could have thrown some proofs in between, he mostly "says" things without ever proving them. Yes, we can get the proofs from anywhere else, but I want to hear what would his approach be.
yeah, it's weird yet fantastic!
Lies again? Postal Code
This video clears up my questions and made this topic easy for everyone
@@tarunkalluri1799 That would make the lectures much longer and means little to the general audience. This is just an introductory course much like entry-level calculus - it is doubtful most students would benefit from being taught real analysis as they are grappling with the idea of derivatives for the first time.
Strang is a legend. He should get an ovation everytime!
I do, and I believe there’s at least one person who does for each lecture; I guess we collectively give him an ovation. :)
i feel the same, in german unis there is this tradition to knock on the table as a form of applauding. I always feel like strang deserves this, too.
For people who deal with statistics, this lecture is probably the most important in the entire series. This is so fucking good.
a bit late but could you develop on that?
@@ramonmassoni9657 he was referring to multivariate linear regression which is a huge topic in statistics.
@@ramonmassoni9657 I'm a statistician, but the explanation about why the projection matrix is equal to its square is something I had never thought about. And yes, that property of the projection matrix is absolutely key in multivariate linear regression, which is a very important method in statistics.
This kinda thread itself also underpins and strengthens this body of knowledge about linear algebra set up by prof. Strang
The combination of lecture 14 and 15 are works of art, things of beauty.
Thank you MIT. Thank you professor Strang.
You don't erase the board at MIT! You just raise it! :P
The thing I really like about these old timer Professors are the way they teach, he stops and ask questions as if he is also going through the problem he already knows everything but in the moment he is walking through us students and trying to look problems through our eyes, I would say this is the greatest method of teaching.
This teaching method only works if the instructor has a rock solid understanding of the subject.
I just can't thank you enough for showing such a clear picture of these concepts. I was struggling to understand 3D Computer Vision and how the linear algebra involved in it. Your lecture series has connected all the points which I have tried very hard enough to understand but I couldn't until I followed your lecture series. You have shown the whole picture by explaining the logic behind each and everything. You are an awesome professor. Thank You so so much. The way you explain is incredible, brilliant.
SO DO I !!!
I rewatch this at least once a year and it never fails to amaze me, beautiful work professor
The Lecture has become immortal, sir! Thank you!
(Ref - first sentence of Prof. Strang in the lecture)
I can barely hesitate to say that these lectures are incomparable to the lectures I attend for Linear Algebra at university. It's uncanny how often when watching these videos I think, "I get it now, I get it!" Cudos to you Prof. Strang!
Good for non mathematics
This is the best explanation of the projection formula that I have ever seen. Prof. Strang not only provides a mathematical basis of the formula by deriving it, but also provides clear intuition and motivation. He also takes the time to go through the simpler case of projecting onto a line first, which allows building up the understanding of the content gradually. What a great lecture!
Now I finally understood the linear regression in its matrix form
Somethings are so beautiful when comprehended a certain way.
Prof. Strang's lecture are as much about the art of transfering such beautiful comprehension one might have experienced as it is about Linear Algebra.
Many in youtube have the skill of making a difficult things easy to grasp. But what you also get from Prof. Strang is that sense of euphoria that comprehension of something beautiful invokes.
The great thing about these recorded lectures, is that I can pause the video each time Dr. Strang asks a question, and spend several minutes thinking about it, or working it out on paper on my own, before proceeding. It takes me three times as long to get through the lectures, but I feel like it is time well spent.
These kids rush out every time. They have no idea the blessing they were given. We never know how impressive a good instructor is until we are trying to learn these things on our own later in life. Thank you for making this available to all. (Yes, I rushed as a young college kid too, young people can be stupid.)
When you start asking questions yourself and find solutions of it hidden inside the teachings, you know how great the lecturer is to give you that sort of understanding. Thank You Mr. Strang for this immortal course.
One of the crown jewel lectures of MIT OCW.
@@hyungjoonpark83 it is the most visited mit ocw course
Rushikesh Shinde No surprise there. I’ve gone through a few of them, and this one is my favorite by far. Dr. Strang’s lectures are brilliant and intuitive, and he just has such a warm and likable personality. You really feel like he’s actually your professor.
This video is just incredible. I've been watching the Khan Academy LA videos and have covered this over there, but seeing this gives me yet another point of view. Coming at it from a slightly different angle is so good at solidifying the concepts. In this lecture I find Professor Strang keeps things high level and really shows the power of thinking at the high "linear algebra" level. Nice to see a video on projection without a cosine in sight :)
I asked to my prof " why do we minimize the square of the error in the LSM?"
He replied "To reduce the distance"
today I understood what does he mean by that after 3 years
The subtle but crucial shift from row space to column space using matrices at the end was just phenomenal!
This lecture has made my day
When i connected dots in my head around 15 minutes when professor was talking about why we do this projection thing, it was one of the most mind fucking blown moments in my mind. I felt like going from top to bottom in the tiny brain - galaxy brain meme in a span of a second. Amazing course
I m in love with how humbly he finishes his lecture.His lecture will be Immortal.
Professor Strang is the BEST! Makes me motivated to enter MIT
Eugene Lee soo.. you entered MIT ?
Did you graduate from MIT now?
Have you started your career using your MIT degree?
@@renney77 Are you an MIT faculty member?
Whenever I feel a little off and distracted I go through the comments, get motivated and excited all over again to learn from the legend himself !
This is his first lecture that I watch about a topic that I didn't previously know. Now I can finally see how brilliant he is at explaining because I have never heard any of this stuff before and it still makes sense the first time I hear it. My brain almost exploded at the complex and yet simple beauty of what he's explaining. It's almost like he's doing a magic trick because we know all the laws of math and he can just take them and make something possible that I never would have thought possible.
I smiled when he casually introduced the concept of linear regression.
Got different view on how this works using matrix.
I saw this video fours years ago when I was an undergraduate student having linear algebra class, and now I saw it again when I am a graduate student, He is just a legend!, No one teacher I have ever seen can be compared to him.
This lecture along with the entire course and you yourself will always remain immortal Prof Strang.
Thank you from almost the entire world who have benefitted from these golden amazing insightful flawless transitioned lectures. You are a mathematical genius. Hope you read this comment someday and realise you have the biggest Indian Fan.
2020 now, he did make it immortal
This professor is a genius :)
You experience so many Ahha! moments in the lecture!
I have watched lectures 14, 15, 16 over and over again, and gain new insights each time. Professors, including mine at the university, tend to drop the arrow sign above vectors while writing on the board. This causes great confusion for the uninitiated. For example, in this lecture there is an expression "p=ax" whether the writing "ax" means a (a scalar) times x (a vector) or a (a vector) times x (a scalar) is not that obvious. Admittedly, the confusion stems from my ignorance of the commutative property of scalar multiplication of vectors, which is, in fact, not mentioned explicitly in most textbooks (e.g., Lay et al, ; Larson & Hostetler). In retrospect, this "p=ax" notation is a prelude to the ingenious way of introducing projection matrix, which again, requires pre-knowledge of associative laws. Overall, these are great lectures that stimulate thinking. Thanks a lot.
b-[(a×b/|a|×|b|)×|b|×a/|a|] a×b/|a|×|b| is a additionstheorem cos α cos β × sin α sin β = cos(α-β)
b - (a×b)/|a|^2 × a a×a=|a|^2
Regards from Germany
Thank you Professor, i am a medicine doctor. I just wanted to learn linear algebra out of curiosity. Even I, who had not dealt with mathematics for a long time, was able to understand the subject. Thank you very much indeed.
This lecture is amazing! This is the deepest understanding of linear regression one could get.
Thanks MIT for sharing it with the world ❤️
I am binge watching this series .....at the end of each one I tell myself that I will watch just one more episode :) !!
Note: Transpose(a)*(b-xa) is the dot product expressed in matrix multiply notation.
Confused me for a moment.
tks ,your reply helps me
@@user-uv5mq5pi6r second you
Hard to appreciate how well presented this is in first go around. The more one learns LA the more one appreciates this style of presentation.
I always thought econometrics taugh with sums was confusing. I finally found an intuitive way to understand least squares. The minimization of errors proof is cool, but the simplicity of your proof combining the left nullspace,is awesome; thank you once again professor Strang.
Professor I am preparing for an entrance exam and your lectures are helping me most. Thank you professor Strang.
This lectures makes the idea of linear regression crystal clear.
I hope these mit videos stay the same for 20 more years. I want my kids to watch the same videos
In all this time. this is by far the best explanation of least squares I've ever seen. Honestly thank you very much for the video.
I have no business bing here. Not in a math or engineering field. I never see linear algebra except at night, on long flights, or anytime I want to escape into a world of abstract spaces and subspaces with the immortal Professor Strang as my guide.
I am watching in 2020 and I must say it is fresh as mortal. Long Live Prof.
Thank you Professor Strang and MIT. This is fun and great! It boils everything down to the fundamentals. Best you can get!
Watching this in 2020, legendary to date!
This is not a lecture. It's a projection matrix that projects everything in the chapter onto the viewer's brain.
My mind is about to get blown away. What appeared to be a dry, intangible, and futile branch of mathematics in the first few lectures turned out to answer one of the most gnawing questions, the answer to which was kept as a mystery for my entire life: How did people come up with the method of least squares? Why least squares? Says who?
I love this guy!
Thanks to Gilbert Strang and MIT
With all my endurance I listen to this saga until this lecture just to understand Linear Regression
ML students be going SMH
The most beautiful math lecture I have ever seen
Is Gilbert Strang the God of Linear algebra? I loved this lecture :)
Finally I understood the origin of the least squares method... (i'm in 2nd year of aeronautics and this teacher is a thousand times better than my university ones. A few could learn how to teach additionally to the algebra lesson)
As a PhD guy, I can say if you master in this course, actually you master at LOTS of high-level subjects like econometrics, engineering, applied math, chemistry etc. Those "graduate" level courses sometimes just repeat the basic ideas from this course and make them hard to understand.
"make this lecture immortal"
I have so much difficulty coping with my Linear Models subject. Thank you prof for this! You're a blessing. Continue uploading your lectures. You are a great help to us!
Dr. Strang this lecture uses some abstract methods which help me understand projections onto subspaces much better.
How come they did not applaude at the end? OMG you are awesome man!!
I got goosebumps the first time I saw this lecture. He is an incredible teacher.
If Plato was right about theory of forms I'm pretty sure that this is the IDEAL lecture.
Nobel Prize for teaching linear algebra.
I just realized multivariable calculus is the prereq of this course. I understand most of the part but there was confusion sometimes. Now I need to take cal 3 so I can continue these awesome lectures from professor Strang.
You missed the whole point of Strang’s gentle wise career which is that calculus before linear algebra is stupid and wrong, actually, linear algebra should precede calculus. We have been unnecessarily tortured and many of us our math careers destroyed, ended, by the unwise reverse decision. LA is much more comprehensible, useful, inspiring, and generally useful than calculus which I’ve never used after a PhD and 30 years more. I really wish my high school had offered linear algebra first. Then so many would have not dropped out, and would have been better served by their effortful learning.
My university didn't even teach me projections. After being introduced to PCA (A concept used in machine learning) I came to know this topic. Alas!
wow, this lecture has opened my eyes. Thank you, professor Strang!
my mind is blown! not by linear algebra... but by Gilbert Strang's teaching
This is brilliant, go MIT!
42:00
Least squares fitting by line
other colleges should be envious that MIT has a great of a professor as Dr. Strang
Txafter
and other countries
I am lucky to have the teacher that explained us linear regression THAT VERY WAY! :D
He made some nonintuitive things intuitive with just some simple example, love his videos
My main man Gilbert "strong" Strang is a BOSS!!! Thank you so much for the lecture!!!
This series is making my life so easy
It is immortal at 2019
Just to the point! Clear and Concise! He is my hero!
Damn, this is a great lecture.... somehow connect to the least square problem by the interpretation of pure linear algebra without using calculus. what an enlightenment.
thanks professor Strang, you don't know how helpful this is for many of us!
"Don't take the videotape quite so carefully"... Camera zooms in right after lmao
I laughed so hard at 40:57 when professor Strang said, "God, eight (A)-s in a row is like, obscene but..."😂
This is phenomenal.
Professor Strang, You are immortal !! 🙏🙏🙏
Gill gets savage on Trig 2:30
How can i just remember every bit of these lectures always? This is education in its true sense, sometimes i feel watching video is a better form of education than personal interaction, if you understand wat i mean
intuition behind linear regression is awesome..
Yeah, it really was that good of a lecture. Professor Strang's Immortal Lecture.
omg.. this is just amazing, thank you MIT thank you professor Strang
now i can feel the art of the linear algebra
I really have to think and imagine a lot in this lecture and I loved it
OMG!!! Best way to understand least square!!!
This is best lecture everrr
Hats on the xs, hats off to Professor Strang!
e in N(At) is perp. to C(A) just killed me. 30:30
How smooth can someone explain the "big picture" step by step over weeks.
Hats off to professor Gilbert strang
This is art ! Thank you Prof. Strang
Legend... Thats one word match their capability :)
Is he taken? I’m in love.
you got a great taste honey
I believe e is also in the null space of A because e is perpendicular to the plane, which implies Ae=0.
The lecture is sooooo satisfying
Bless you, Dr. Strang. Your lectures should be part of an Arctic Vault/Time Capsule so that aliens can drink from the fountain of your knowledge.