The Covariance Matrix : Data Science Basics

แชร์
ฝัง
  • เผยแพร่เมื่อ 1 ต.ค. 2024

ความคิดเห็น • 239

  • @ebenvia
    @ebenvia 3 ปีที่แล้ว +90

    This is one of the most clear, straightforward stats video I've seen in awhile! 👍

  • @johningham1880
    @johningham1880 4 ปีที่แล้ว +51

    I was following while it was all about apples and bananas, but got lost when you started performing pear-wise operations

    • @ritvikmath
      @ritvikmath  4 ปีที่แล้ว +9

      wow ... hilarious!

    • @captincanuckjones1664
      @captincanuckjones1664 3 ปีที่แล้ว

      @@ritvikmath That's not nice!

    • @captincanuckjones1664
      @captincanuckjones1664 3 ปีที่แล้ว +4

      I am assuming that you got lost when he said that the Expectation of A * Expectation of B cancel out to zero. By that he meant A= 1* 3 * -1= -3, B= 1*0*1=0 So, the Expectation of A = -3, and the Expectation of B=0, now, multiply A(-3) * B(0) = 0;

    • @GinMCS
      @GinMCS 3 ปีที่แล้ว +8

      @@captincanuckjones1664 The joke was the 'pear'-wise operations (cause you know... fruits), but it's nice of you for explaining!

  • @traich
    @traich 4 ปีที่แล้ว +27

    You're an amazing instructor and I really enjoy your videos. Great content.
    Can I make a small suggestion regarding a technicality - the camera seems to be fishing for focus every time you move in closer to it. If you manually focus and fix the focal distance so that the board is in focus, whenever you move closer only you will go out of focus for a brief moment ( not necessarily, if there is sufficient light you can use a small aperture that will allow for a greater focal distance ) and avoid the pitfalls of the slow autofocus.

    • @ritvikmath
      @ritvikmath  4 ปีที่แล้ว +17

      Thank you so much for the suggestion! I had a couple videos around this time where the focus went in and out and I apologize for that. In my more recent videos, fortunately I did exactly what you suggested so they are easier to watch. Thanks!

  • @Captain_Rhodes
    @Captain_Rhodes 4 ปีที่แล้ว +22

    thanks. make more videos. you have a talent for keeping thinks understandable

  • @djd829
    @djd829 3 ปีที่แล้ว +13

    After giving Khan Academy a shot at explaining this poorly I came across this. Perfect. Thank you!

    • @jakemaxton1714
      @jakemaxton1714 3 ปีที่แล้ว

      i dont mean to be so offtopic but does any of you know of a trick to get back into an instagram account..?
      I was dumb forgot my login password. I would love any help you can give me!

    • @brodieharley7040
      @brodieharley7040 3 ปีที่แล้ว

      @Jake Maxton instablaster =)

  • @alimuqaibel7619
    @alimuqaibel7619 3 ปีที่แล้ว +4

    Excellent presentation but at 2:21 .... confused correlation with covariance with correlation coefficient. Correlation is not bounded between -1 and +1 that is rather the correlation coefficient Correlation coefficient is the one that is bounded. Also the explanation given ... when one is positive and the other is negative ... (that is the definition of correlation) Covariance has to be defined relative to the mean. Please double check in any Standard Statistics Book including Peebles or Papoulis... The presentation style and clarity is excellent. Keep up the good work.

  • @DistortedV12
    @DistortedV12 4 ปีที่แล้ว +13

    Can you do a series leading up to Gaussian process? I like your way of explaining things.

    • @Spiegeldondi
      @Spiegeldondi 3 ปีที่แล้ว

      plus one from my side!

  • @ahmedalaaeldinmohamed9146
    @ahmedalaaeldinmohamed9146 2 ปีที่แล้ว +6

    I can't believe how you make things that easy. Thx for this awesome content.

  • @NugrohoBudianggoro
    @NugrohoBudianggoro 4 ปีที่แล้ว +9

    huge thanks for the explanation. i was reading a book about this but i couldn't get my head around it. your explanation clear things up. best of success to you, bro..

  • @DariaEmacs
    @DariaEmacs 4 ปีที่แล้ว +2

    Thank you! This is the best explanation in the world! It really helps me! 👍

  • @andreyb7419
    @andreyb7419 3 ปีที่แล้ว +5

    You describe things in absolutely clear and simple way, thx for doing this!!!

  • @hossanatwino
    @hossanatwino 3 ปีที่แล้ว +6

    Really simple and great explanation of the covariance matrix. It would be great if at the end you tell us what the covariance matrix means in terms of whether there was a relationship between eating a banana and apple - in this case, that yes, there is a positive relationship.

  • @Nova-Rift
    @Nova-Rift 3 ปีที่แล้ว +1

    Don't you need to center the data by subtracting the mean first from all the data?

  • @Milad_showcase
    @Milad_showcase 4 ปีที่แล้ว +1

    Thank you. Very helpful video. Good luck

  • @sahirbansal7027
    @sahirbansal7027 4 ปีที่แล้ว +2

    hey, can we subtract mean from each term to make each column zero mean before calculating covariance matrix. also some texts divide by n-1 instead of n. why is that? Thanks

  • @leaboss3223
    @leaboss3223 4 ปีที่แล้ว +3

    Hi! Shouldn't one devide by N-1 instead of N ? Because we compute the means from the samples. Should Cov(A,B) then not be 2/(3-1) instead of 2/3? Thanks

    • @OsamaShehzad1995
      @OsamaShehzad1995 4 ปีที่แล้ว

      He is taking the covariance of entire population i.e. all 3 people therefore, he divides by N. Had he taken a sample out of this population, he would have divided by N-1.

  • @SarikaKamble-pm2hq
    @SarikaKamble-pm2hq ปีที่แล้ว +3

    I was struggling with this concept. You made it very simple and easy to understand. Thank you for this amazing content.

  • @marvinpolo3180
    @marvinpolo3180 3 ปีที่แล้ว +1

    me: 2 km/h * 1 hour = 2
    teacher: 2 what? aPplEs? bAnanAs?

  • @marcozocker1963
    @marcozocker1963 4 ปีที่แล้ว +7

    I'm from Germany and I understand you more then every german speaking teacher here

  • @Arslanqadri
    @Arslanqadri 4 ปีที่แล้ว +3

    What does the covariance matrix mean as a whole, i have seen it being used as an entity. Something intuitional as matrix multiplication here?

  • @liamhan8145
    @liamhan8145 2 ปีที่แล้ว +2

    So simple yet so clear. Thank you so much! Subscribed and can't wait to watch your other videos!

  • @joel09878
    @joel09878 3 ปีที่แล้ว +3

    Thanks for making an effort to explain things at a slow pace. I love the way you don't use technical terms to explain things immediately, but then you do give us the technical term once it's explained. Much appreciated and subscribed.

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว +1

      You're very welcome!

  • @lcaslokonon3979
    @lcaslokonon3979 4 ปีที่แล้ว +4

    Great real life explanation - extremely helpful. Thank you so much!!

  • @ОльгаАвдюхина-н4ж
    @ОльгаАвдюхина-н4ж 3 ปีที่แล้ว +1

    Thank you great guy!!!!
    how can we calculate correlaion matrix for 3 random variables?

  • @exxodas
    @exxodas 3 ปีที่แล้ว +2

    I like how you give us little refreshers about concepts we may have forgot.

  • @kevin-johar
    @kevin-johar 2 ปีที่แล้ว

    The equation he used for covariance seems to give the same results as another formula I see being used as the standard online, I just can't figure out how to view them as equal.
    The equation I see online is E[(x_i-E(x)) (y_i-E(y))]
    Would love some clarification.

  • @inaswulanramadhani4036
    @inaswulanramadhani4036 2 ปีที่แล้ว

    Great explanation, sir. But, what if Apple matrix isn’t real number, I mean Apple matrix is just variable (y1, y2, y3)?

  • @oliverwilliams9507
    @oliverwilliams9507 3 ปีที่แล้ว +1

    excellent video, thanks very much

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      You are welcome!

  • @bluejays440
    @bluejays440 2 ปีที่แล้ว

    Excellent explanation. No confusion. No bullshit. Just 100% fruit

  • @theonionpirate1076
    @theonionpirate1076 3 ปีที่แล้ว +1

    There's actually an important difference between covariance and correlation. Yes, for both, in general you want that the larger one variable gets the larrger the other gets, and vice-versa. However, for covariance, if the value of one variable were fixed, you will always get a larger covariance if you make the other variable of greater magnitude, with the same sign as first variable. So for instance, if there were values for apple enjoyment of -3, -2, -1, 0, 1, 2, and 3, and they were fixed, you'd increase the covariance by choosing the values of banana enjoyment to be as negative as possible for the negative apple values and as positive as possible for the positive apple values (the 0 one wouldn't matter).
    On the other hand, (linear) correlation measures the degree to which the variables fall on a line. So, with the same example as above, we'd maximize correlation by choosing values of banana that were, say, equal to each for apple, or any set of values that make a straight line. This clearly means we would NOT want to just choose the largest magnitude, with appropriate sign, banana values that we can.

  • @data-science-ai
    @data-science-ai 2 ปีที่แล้ว

    Yeah, might want to check your definition of covariance. I'm pretty sure you understand it intuitively but I suggest polishing your definition. It's not so much that two variables "go together." its the measure of how they vary together i.e. if an observed change in x relative to the expected value of x is observed by an equal or similar change in y relative to the expected value of y. It is not dependent on whether the change is in the opposite (+ or -) direction.

  • @tiwiex
    @tiwiex 29 วันที่ผ่านมา

    I actually thought it sounded like correlation just before he said it at 2:08. Like he actually read my mind. 😂

  • @guillermoalcantaragonzalez6532
    @guillermoalcantaragonzalez6532 3 ปีที่แล้ว

    "The correlation is standardized covariance, normalizing the covariance with the standard deviation of each variable."
    From: www.cambridge.org/9780521766333

  • @shipper611
    @shipper611 4 ปีที่แล้ว +1

    Great video, would be awesome to give a little more intuition on why these numbers are so insightful ;)

  • @louishollick8904
    @louishollick8904 4 ปีที่แล้ว +2

    Great video!

  • @alireza98325
    @alireza98325 4 ปีที่แล้ว

    1. disable auto focus,
    2. set camera to manual focus,
    3. focus on the white board,
    4. thank me later

  • @AmelZulji
    @AmelZulji 3 ปีที่แล้ว

    Very often one can see a formulation like variance-covariance matrix. Is it the same as covariance matrix and are being used interchangeably, or variance-covariance matrix should denote something else?

  • @andrelu3561
    @andrelu3561 3 หลายเดือนก่อน

    This means that apples are far better than bananas right? So when I've been told that you cant compare apples and bananas ... thats a lie ...

  • @ahmedm.alfadhel272
    @ahmedm.alfadhel272 4 ปีที่แล้ว +1

    well done

  • @shashank4277
    @shashank4277 ปีที่แล้ว

    hi..can you please tell at the last when you have derived the matrix value what does it symbolize ,i mean what does matrix should be interpreted?

  • @rainerwang1712
    @rainerwang1712 3 ปีที่แล้ว +2

    Best explain on this topic! Concise and human friendly

  • @ZombieTurtle00
    @ZombieTurtle00 4 ปีที่แล้ว +3

    Greatly informative video, thank you! :)

  • @mshirazbaig6055
    @mshirazbaig6055 2 ปีที่แล้ว

    You are speaking too fast and your example chosen could have been better.

  • @camilamiraglia8077
    @camilamiraglia8077 3 ปีที่แล้ว +1

    Great video! Thank you

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Glad you liked it!

  • @MYJESUSCHANNEL2022
    @MYJESUSCHANNEL2022 ปีที่แล้ว

    I want to express my appreciation for tutor. Thank vey much

  • @gautamsuryawanshi2642
    @gautamsuryawanshi2642 3 ปีที่แล้ว +1

    Hi, Ritvik you are creating awesome content. Please do keep creating such beautiful content.

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Thank you so much 🙂

  • @Rizomus
    @Rizomus 3 ปีที่แล้ว

    So, I didn't understand is there any link between happiness...

  • @osamansr5281
    @osamansr5281 3 ปีที่แล้ว

    something is wrong :(
    online calcs don't return the same matrix!

  • @indigo1417
    @indigo1417 7 หลายเดือนก่อน

    Thanks, helped a lot. Liked and subscribed

  • @wobushiwaizui
    @wobushiwaizui 2 หลายเดือนก่อน

    I think you are not multiply the bias factor right?

  • @deadbeef33
    @deadbeef33 2 หลายเดือนก่อน

    Amazing explanation! Thank you!

  • @AJ-et3vf
    @AJ-et3vf 3 ปีที่แล้ว

    Thank you very much sir. Very helpful!

  • @adrianjohn8111
    @adrianjohn8111 5 หลายเดือนก่อน

    sir
    you are awesome
    thank you
    second video I stumbled across and it was so clear

  • @harshamusunuri1924
    @harshamusunuri1924 3 ปีที่แล้ว +1

    let me say this once and for all, "there is a huge requirement for professors like you at all the universities on the planet if they have to sustain in future"

  • @adammontgomery7980
    @adammontgomery7980 8 หลายเดือนก่อน

    Is correlation just normalized covariance?

  • @paramita14
    @paramita14 ปีที่แล้ว +1

    You're an excellent teacher! Wish to see more Stat videos from you! Thank you so much!

  • @hillcipher7392
    @hillcipher7392 5 หลายเดือนก่อน

    Thanks for this amazing explanation!

  • @Neptoid
    @Neptoid 8 หลายเดือนก่อน

    seems like a payout matrix from game theory

  • @janinajochim1843
    @janinajochim1843 4 ปีที่แล้ว +1

    Hi there :)
    Extremely well explained video, thank you!
    I ended up here as I am trying to run Little's test for missing variables in Stata and the error I am getting says "sample covariance matrix is singular for at least one missing-value pattern" -- Whilst (after some videos)I know what that means in theory, I have no idea what to do with that information now, how it affects my test, and/or if that means I should exclude the 'problem-variable' or use a transformation. Do you have any recommendations? Thank you in advance!

  • @laureanodiaz4297
    @laureanodiaz4297 3 ปีที่แล้ว +1

    To the point, exemplified, condensed and so useful. Thanks for this video!

  • @solitudeguard1932
    @solitudeguard1932 2 ปีที่แล้ว

    I like pros when they speak about what they know.

  • @theflippedbit
    @theflippedbit 4 ปีที่แล้ว +2

    your channel deserves way more traction and sub count. keep up the good work. Thanks!!

  • @schaukeltiger596
    @schaukeltiger596 2 ปีที่แล้ว

    Very cool video, thanks for that :)

  • @elsins9790
    @elsins9790 3 ปีที่แล้ว +1

    Besides StatQuest a really good and growing statistics channel. Subbed.

  • @ben6
    @ben6 4 ปีที่แล้ว +1

    Thank you for that clear explanation. I don't have time to relearn statistics at the moment.

  • @mdsarker7046
    @mdsarker7046 3 ปีที่แล้ว

    Your video is really easy to understand even someone doesn't have math degree

  • @jedisct1
    @jedisct1 4 ปีที่แล้ว

    If the covariance represents how much something and something else are related to each other, why isn’t covariance(A, A) equal to 1 ?

    • @salsadude12
      @salsadude12 4 ปีที่แล้ว

      Cov(A,A) is just the variance of A, so the value will be whatever Var(A) is

  • @MansiMehta-n3v
    @MansiMehta-n3v 3 หลายเดือนก่อน

    Best video on covariance...thnks man

  • @tyson96
    @tyson96 2 ปีที่แล้ว

    Very well explained. Thank you

  • @geophysicsadvancedseismice7542
    @geophysicsadvancedseismice7542 3 ปีที่แล้ว

    Hi, What are Correlation range and exponential correlation orders and how we can compute for variables (are in vector form or arrays)?

  • @tb.adindalaksmana3634
    @tb.adindalaksmana3634 3 ปีที่แล้ว

    Nice explanations .. thank you

  • @elliamaris
    @elliamaris 2 ปีที่แล้ว

    Thank you so much for this video!

  • @emilioalfaro4365
    @emilioalfaro4365 2 ปีที่แล้ว

    Super understandable, thank u sm!

  • @HawkEyeLondon
    @HawkEyeLondon 4 ปีที่แล้ว +1

    Thank you so much for this very helpful and intuitive video. It really helped me understand specifying mixed models in R!

  • @sudeep15
    @sudeep15 4 ปีที่แล้ว +1

    Great explanation!!!!

    • @ritvikmath
      @ritvikmath  4 ปีที่แล้ว

      Glad it was helpful!

  • @rohanpande5074
    @rohanpande5074 4 ปีที่แล้ว

    Thank you for making videos

  • @sepehrjafari793
    @sepehrjafari793 ปีที่แล้ว

    Great video! I wish I would have some free time to enjoy teaching math and stats on TH-cam!

  • @stephanschaefer155
    @stephanschaefer155 4 ปีที่แล้ว

    Don't you divide the sum of squared difference by (n-1) to get the variance? Great video. Thank for explaining so clearly.

  • @solomonebabu6811
    @solomonebabu6811 3 ปีที่แล้ว +1

    You are a wonderful

  • @danielwiczew
    @danielwiczew 4 ปีที่แล้ว +1

    @ritvikmath
    So the correlation matrix could be called a normalized covariance matrix ?

    • @ritvikmath
      @ritvikmath  4 ปีที่แล้ว

      Yes you can think of it in that way !

  • @jevz7028
    @jevz7028 2 ปีที่แล้ว

    Really appreciate the good work

  • @justinscherzer5593
    @justinscherzer5593 2 ปีที่แล้ว

    Thank you, super clear!

  • @fatimegashi1595
    @fatimegashi1595 3 ปีที่แล้ว +1

    Really good explanations - clear and concise. Thank you.

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Glad it was helpful!

  • @malikamdallel2724
    @malikamdallel2724 2 ปีที่แล้ว

    thank you but we need interpretations

  • @aurorasart9458
    @aurorasart9458 2 ปีที่แล้ว

    Thank you so much. In 10 minutes you explained it so clearly :D keep on with your videos!!!

  • @amalsal9559
    @amalsal9559 ปีที่แล้ว

    Wow! Now math seems fun and easy!

  • @seytanc4
    @seytanc4 4 ปีที่แล้ว

    good video. one comment: disable the autofocus in your camera when shoting whiteboard lectures, waiveing the hands in front of the camera puts it out of focus

  • @sawyermade5469
    @sawyermade5469 4 ปีที่แล้ว +1

    Noice!

  • @haiderkamal1106
    @haiderkamal1106 3 ปีที่แล้ว

    Thank You sooo MUCH!!!!!! This was a brilliant way to teach!

  • @HasanAlMasri
    @HasanAlMasri ปีที่แล้ว

    God Bless YOU! you saved me!

  • @acrlnv
    @acrlnv 4 ปีที่แล้ว

    i wish i had professors like this in the uni. maybe i wouldnt have hated statistics so much.

  • @dante3578
    @dante3578 2 ปีที่แล้ว

    so clear, thank you sir!

  • @abtinmeysami6551
    @abtinmeysami6551 2 ปีที่แล้ว

    Thank you very much your explanation was great, the only question is that what is the relation between the curve you plotted at the first of the video and the calculated matrix?

  • @isaaclee1943
    @isaaclee1943 4 ปีที่แล้ว

    things I don't like your lecture is. You are always covering the board. Can't do screenshot.

  • @nehdiwmbcuow868
    @nehdiwmbcuow868 2 ปีที่แล้ว

    Awesome straightforward explanation thank you

  • @SuperReddevil23
    @SuperReddevil23 4 ปีที่แล้ว

    Great explanation Ritvik as always. Please can you make a series of Videos on Financial Calculus....?

  • @mohamedjafris7918
    @mohamedjafris7918 4 ปีที่แล้ว

    pls mention that this is doing only for the population, not for the sample. because there has another equation for covariance. that can be done both population and sample also.
    reference: corporatefinanceinstitute.com/resources/knowledge/finance/covariance/

  • @kirillnn9754
    @kirillnn9754 ปีที่แล้ว

    very usefull! thanks a lot

  • @nandakumarcheiro
    @nandakumarcheiro 3 ปีที่แล้ว

    The meaning this matrics information out of the covariant matrics must be explained perhaps by salt and sugar percentage as titration process.

  • @orugantijyoshna7445
    @orugantijyoshna7445 3 ปีที่แล้ว

    Understanding very well sir