Maximum Likelihood - Cramer Rao Lower Bound Intuition

แชร์
ฝัง
  • เผยแพร่เมื่อ 12 พ.ย. 2024

ความคิดเห็น • 66

  • @AndrewCarlson005
    @AndrewCarlson005 5 ปีที่แล้ว +16

    THIS MAKES SO MUCH SENSE!! Thank you so much for explaining this more clearly in a few minutes than my textbook could do in a few hours!

  • @Borey567
    @Borey567 8 ปีที่แล้ว +112

    I think this small video worth few 2hrs lectures in a university.

    • @dragosmanailoiu9544
      @dragosmanailoiu9544 5 ปีที่แล้ว

      lmao true

    • @123456789arty
      @123456789arty 4 ปีที่แล้ว +1

      I just watched a 1 hour lecture about Cramer-Rao Lower Bound and you are totally right :P this was waaay more informative.

  • @satltabur4597
    @satltabur4597 3 ปีที่แล้ว

    In 7m and 59s you explained it better and more clearly than many 2h university lectures combined.

  • @oscarlu9919
    @oscarlu9919 4 ปีที่แล้ว +1

    This explanation is excellent. It is crystal clear to explain why is the inverse relationship between variance and second derivative, and why is second derivation, and plus why it is negative! Bravo, Prof.Ben!

  • @andrewedson7010
    @andrewedson7010 4 ปีที่แล้ว

    Studying for actuarial exams and the material just throws Fisher Information at you with no context. This will help me understand exactly what we are expected to do in the calculations. Thank you

  • @accountname1047
    @accountname1047 2 ปีที่แล้ว +4

    This was my intuition when studying ML estimators in statistics, but never got a straight answer about it from my teachers. Happy to see others think of it through a geometric lens! Great video

  • @jaymei2532
    @jaymei2532 5 ปีที่แล้ว +4

    Like everyone else said, very well explained. I feel way less jittery about this whole entire concept. Thank you in 2019!

  • @johannaw2031
    @johannaw2031 ปีที่แล้ว

    This video makes me very clear about one thing, that I find it strange how hard it obviously is for professors to provide some clear intuition. Why must it be so hard to be pedagogical when you really know something, which I expect a professor does. This is a working day of headache over horrible handouts made understandable in 5 mins.

  • @LongyZ13
    @LongyZ13 10 ปีที่แล้ว +1

    Really appreciate videos like this where the aim is to provide an intuitive explanation of the concepts as opposed to going into detail on the maths behind them. Thanks.

  • @yukew4106
    @yukew4106 4 ปีที่แล้ว

    Hi Mr. Lambert, I just want to take a moment to thank you for taking the time to make these videos on TH-cam. They are very easy to understand and by watching your videos I have been able to understand my statistical theory and bayesian statistics courses more as an undergrad. Thanks a lot and I wish you all the best!

  • @Manny123-y3j
    @Manny123-y3j 3 ปีที่แล้ว

    Damn. You explained this so well. I never have any idea what my professor is talking about, but videos like this help SO MUCH. Thank you!

  • @ishaansingh1789
    @ishaansingh1789 10 หลายเดือนก่อน

    Beautifully explained my friend- intuition is almost always as important as the actual proof itself

  • @HappehLlama
    @HappehLlama 9 ปีที่แล้ว +13

    This was a fantastic intuitive explanation - thank you!

  • @tomthefall
    @tomthefall 2 ปีที่แล้ว

    this is the best video ive seen on this topic, very well done

  • @Byc845
    @Byc845 4 ปีที่แล้ว

    The point of view in curvature is soooo great!

  • @irocmath9727
    @irocmath9727 4 ปีที่แล้ว

    Wow! This clarifies a good week or two from last year's lectures. I wish I had seen these videos when I was taking the course last year.

  • @mehinabbasova5013
    @mehinabbasova5013 7 หลายเดือนก่อน

    This makes so much more sense now, thank you!

  • @Trubripes
    @Trubripes 5 หลายเดือนก่อน

    High curvature -> sharp -> concentrated -> low variance. Makes sense.

  • @leza7584
    @leza7584 2 ปีที่แล้ว

    This helps so much. very simple explanation

  • @cecicheng5791
    @cecicheng5791 9 ปีที่แล้ว +2

    wow finally get the idea about this relationship between covariance matrix and hessian

    • @wahabfiles6260
      @wahabfiles6260 4 ปีที่แล้ว

      so in otherowords the covariance matrix is hessian of maximum likellihood?

  • @jubachoomba
    @jubachoomba 3 ปีที่แล้ว

    Those tangents illustrate the convexity... Jensen!

  • @michaelmalone7614
    @michaelmalone7614 4 ปีที่แล้ว

    Wow, that makes things so much clearer. Thank you.

  • @achillesarmstrong9639
    @achillesarmstrong9639 5 ปีที่แล้ว

    OK 3 months ago, I thought I understood this video. After I learned more statistic. Now I understand what is going on. I didn't quite understand the concept 3 months ago.

  • @kimchi_taco
    @kimchi_taco 5 ปีที่แล้ว

    Kudos man! most intuitive explanation ever!

  • @SAGEmania-q8s
    @SAGEmania-q8s 3 หลายเดือนก่อน

    Thank you so much. This explains so much.

  • @aartisingh1387
    @aartisingh1387 10 หลายเดือนก่อน

    Thank you for this video. I have watched this video many times over the years. The simplicity, intuition, visuals, clarity, and ease, are nothing less than brilliant. It has always helped whenever things get fuzzy.
    Just a small request or a question if you may: Calling vertical axis "likelihood of the data" makes it a bit confusing!
    Instead, should it not be "likelihood of the parameter" that is L( theta; data). And this "likelihood of the parameter" then happens to be equivalent to f(data|theta)? So, y axis should not be called L(data|theta)?

  • @unnatishukla8513
    @unnatishukla8513 2 ปีที่แล้ว

    Awesome awesome awesome video....Thankyou so much!

  • @vitorjung
    @vitorjung 3 ปีที่แล้ว

    Excellent video, congratulations!

  • @filipposchristou441
    @filipposchristou441 7 ปีที่แล้ว

    thanks. Good explanation. I guess you saved me hours of searching.

  • @fengdai2304
    @fengdai2304 4 ปีที่แล้ว

    Ben, you are amazing!

  • @1024Maverick
    @1024Maverick 6 ปีที่แล้ว +1

    You just saved my semester (again) GGWP

  • @madhurasutar5332
    @madhurasutar5332 4 ปีที่แล้ว

    Well explained man!!! Thanks a million 🙏

  • @MrYahya0101
    @MrYahya0101 3 ปีที่แล้ว +2

    you said we add the negative sign, because the second derivative is negative after a certain value, and the negative sign is added to correct for that negative. what about when the second derivative is positive? doesn't the negative sign make the second derivative negative then? of what use will that be?

  • @coopernfsps
    @coopernfsps 8 ปีที่แล้ว

    Great video, as always. Helped me out a lot!

  • @jorgebretonessantamarina18
    @jorgebretonessantamarina18 8 ปีที่แล้ว +2

    Wonderful video. Thank you very much!

  • @pumpkinwang548
    @pumpkinwang548 4 ปีที่แล้ว

    Thank u Ben, it was quite helpful

  • @johanjjager
    @johanjjager 3 ปีที่แล้ว +1

    Isn't the variance of theta hat also dependent on n, the number of observations which constitute the likelihood function?

  • @hankyang7466
    @hankyang7466 5 ปีที่แล้ว

    wonderful video, thank you!

  • @alecvan7143
    @alecvan7143 4 ปีที่แล้ว

    Awesome video!!

  • @davidpaganin3361
    @davidpaganin3361 6 ปีที่แล้ว

    Many thanks, much appreciated!

  • @achillesarmstrong9639
    @achillesarmstrong9639 6 ปีที่แล้ว

    wonderful video

  • @flo6033
    @flo6033 6 ปีที่แล้ว

    Thanks, very intuitive.
    [Subscribed]

  • @icosum
    @icosum 9 ปีที่แล้ว

    Excellent many thanks

  • @charlesity
    @charlesity 7 ปีที่แล้ว +1

    Thank you very much!

  • @lucystruthers7876
    @lucystruthers7876 3 ปีที่แล้ว

    Hi ben, thank you so much for your videos, i am studying quantitative ecology and do not have a strong mathematical background - your lessons really help! May I ask how the different values of theta are generated (along the x axis)? I assume the MLE expression stays constant and that the parameter estimates vary due to sample variation but in my case I only have one sample. I am a bit confused whether variance of the MLE is actually referring to variance in the parameter estimate due to sampling error. Secondly, in order to calculate the variance, must the 2nd derivative be evaluated for the value of theta which gives the MLE? I hope these questions make sense!

  • @nikhiln9887
    @nikhiln9887 5 ปีที่แล้ว

    great intuitive :)

  • @Ekskwkwkwkw2309
    @Ekskwkwkwkw2309 3 ปีที่แล้ว

    In wich playlist ı can find this topics in a ordered manner

  • @JanM351531351
    @JanM351531351 5 ปีที่แล้ว

    Very good.

  • @wildboar3170
    @wildboar3170 8 ปีที่แล้ว

    Hi Ben find your tutorials very easy to follow- thanks. What software are you using? Especially like the coloured pens on black background.

    • @atfirstiamhuman9183
      @atfirstiamhuman9183 6 ปีที่แล้ว

      i dont know hat he is using but I sometimes use app.liveboard.online/ . It also allows you to chose different backgrounds for a board and different colors and to livestream your drawing from your tablet/smartphone to PC which i often use as it is better to draw by hand/pen then by mouse.

    • @lastua8562
      @lastua8562 4 ปีที่แล้ว

      You can check his website for info.

  • @archangel5437
    @archangel5437 3 ปีที่แล้ว

    You da best!

  • @Adam-de8yi
    @Adam-de8yi 8 หลายเดือนก่อน

    My student finance payment should be going to people like you, not these institutions.

  • @safiyakorea6390
    @safiyakorea6390 5 ปีที่แล้ว +1

    شكرا و لكن و الله مفهمت 😂😂😂
    نتمنى وضع ترجمة لاحقا

  • @samah241
    @samah241 8 ปีที่แล้ว

    I want to know the meaning of penalized mle

    • @lastua8562
      @lastua8562 4 ปีที่แล้ว

      Are you learning that for Machine Learning?

  • @tallyskalynkafeldens1753
    @tallyskalynkafeldens1753 5 ปีที่แล้ว

    WOW!

  • @HopeNicholas-d8p
    @HopeNicholas-d8p หลายเดือนก่อน

    Jon Plaza

  • @charlesrockhead8900
    @charlesrockhead8900 3 ปีที่แล้ว

    ily

  • @ChristopherThompson-r2z
    @ChristopherThompson-r2z 29 วันที่ผ่านมา

    Kane Park

  • @BrandonGoetter-n9k
    @BrandonGoetter-n9k 29 วันที่ผ่านมา

    Lydia Stream

  • @bgheyer
    @bgheyer 4 ปีที่แล้ว

    Thank you so much!