The Main Ideas of Fitting a Line to Data (The Main Ideas of Least Squares and Linear Regression.)

แชร์
ฝัง
  • เผยแพร่เมื่อ 10 พ.ย. 2024

ความคิดเห็น • 687

  • @statquest
    @statquest  2 ปีที่แล้ว +20

    Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

    • @weixiangzhao561
      @weixiangzhao561 2 ปีที่แล้ว +3

      Everyone should buy this book if you want to learn machine learning. It is the greatest 20 bucks that I have ever spent in my entire life.

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      @@weixiangzhao561 BAM! Thank you very much! :)

    • @dipenpandit684
      @dipenpandit684 ปีที่แล้ว

      This video isn't available in Nepal. Can you please make it available sir? I really love your content. 🙏

    • @statquest
      @statquest  ปีที่แล้ว +1

      @@dipenpandit684 I'm working on it. It's some strange thing with youtube and I've contacted them.

    • @alicefriedman7607
      @alicefriedman7607 ปีที่แล้ว +1

      I love this book! I have taken Stats so many times but I still learned so much. Thank you for writing this book!

  • @rmenchoachupicachu
    @rmenchoachupicachu 7 ปีที่แล้ว +112

    I have been enrolled in a graduate machine learning course for about a month now and you have just demystified so many details around Linear Regression. Please do more ML videos! They are so clear and helpful. If you can, please do one on Regularization and Decision Forests.

  • @toandef3109
    @toandef3109 9 หลายเดือนก่อน +5

    You have no idea how much I appreciate the clarity and simplicity of this explanation, you deserve a medal

    • @statquest
      @statquest  9 หลายเดือนก่อน

      Thank you!

  • @majeedhussain3276
    @majeedhussain3276 6 ปีที่แล้ว +198

    You deserve more subscribers, the quality in your videos is so intuitive that even a high school student understands. Please do upload videos, keep going. I really think ur gonna get more subscribers in future.

    • @adambis337
      @adambis337 ปีที่แล้ว +3

      You were right

    • @wirotep.1210
      @wirotep.1210 8 หลายเดือนก่อน +1

      Can’t agree more

    • @PunmasterSTP
      @PunmasterSTP 7 หลายเดือนก่อน

      Definitely! I'm glad that as of March 2024, he's got over one million subs (1.13 to be exact)!

  • @rishabh2892
    @rishabh2892 4 ปีที่แล้ว +51

    After weeks of research and frustration, I have finally understood the concept of least squares so well! You explained the concepts so simply and logically!! Thank you so much for this amazing video. Much appreciated.

    • @statquest
      @statquest  4 ปีที่แล้ว +3

      Thank you very much!!! :)

  • @kenway346
    @kenway346 4 ปีที่แล้ว +52

    I actually took machine learning as the elective subject for my final year of engineering and I pretty much guess that this channel's going to teach me every thing!

    • @statquest
      @statquest  4 ปีที่แล้ว +9

      Hooray!!! :)

    • @User-l3u6m
      @User-l3u6m 2 ปีที่แล้ว +5

      @@statquest your vids are so good I watch your videos for entertainment lol

    • @PunmasterSTP
      @PunmasterSTP 7 หลายเดือนก่อน

      How'd the machine learning class turn out?

  • @homeboy6668
    @homeboy6668 2 ปีที่แล้ว +25

    I must admit sir, you are one of the best teachers I've ever had. Thank you for being so awesome!

    • @statquest
      @statquest  2 ปีที่แล้ว +7

      Wow, thank you!

  • @maggiechen1141
    @maggiechen1141 3 ปีที่แล้ว +41

    Thank you!! After somehow passing 2 PhD quantitative methods modules and not really understanding why we did any of it, your channel has finally cleared a lot of stuff up!

    • @statquest
      @statquest  3 ปีที่แล้ว +4

      Great to hear!

    • @frankchen4229
      @frankchen4229 2 ปีที่แล้ว +4

      How the hell did you pass

    • @maggiechen1141
      @maggiechen1141 2 ปีที่แล้ว +9

      @@frankchen4229 do what you're told and don't ask why

    • @frankchen4229
      @frankchen4229 2 ปีที่แล้ว +2

      @@maggiechen1141 huh. Maybe PhD isn't so bad.

    • @kapricun
      @kapricun 2 ปีที่แล้ว

      @@maggiechen1141 best advice so far

  • @doge6154
    @doge6154 11 หลายเดือนก่อน +5

    english is not my first language, but i can clearly understand your explanation. Thank you sir!

    • @statquest
      @statquest  11 หลายเดือนก่อน

      Thank you!

  • @odins_claw
    @odins_claw 3 ปีที่แล้ว +7

    Your presentation style is way ahead of anything else on this platform. You don't have the inefficient habit of deriving everything from first principles but allow a holistic intuition to develop. Absolute magic!

    • @statquest
      @statquest  3 ปีที่แล้ว

      Thank you! :)

  • @blessinglotus
    @blessinglotus 4 ปีที่แล้ว +9

    I keep coming back for more! THANK YOU SO MUCH!!! This is so clearly explained than any other tutorial/video/in-class session I've ever listened to! You are the best!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Wow! Thank you very much!

  • @benparasa
    @benparasa ปีที่แล้ว +1

    There are so many videos on this subject where they say what and how to use least squares method of find the line of best fit but you are the only one who explained the concept behind this method. Thank you.

  • @guillermoalvarezbacame5909
    @guillermoalvarezbacame5909 5 หลายเดือนก่อน +2

    This is the best TH-cam channel ever, thank you Josh for all your work you doing awesome!!

    • @statquest
      @statquest  5 หลายเดือนก่อน

      Wow, thanks!

  • @Jef-ur7zv
    @Jef-ur7zv 2 ปีที่แล้ว +3

    the quality of these videos seem to have improved greatly over the years, but the simplicity was always there. Amazing!

    • @statquest
      @statquest  2 ปีที่แล้ว

      Some of the early videos are still the best.

  • @MrCentrax
    @MrCentrax 2 ปีที่แล้ว +5

    I always wanted to know why the formula squares the distance and then get the root instead of using the absolut value. You're the first one to explain this. Thank you!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Thanks!

    • @fertingoff
      @fertingoff 6 หลายเดือนก่อน

      So can you explain in your own words in short then? Thanks

  • @datasciencewithjazz5854
    @datasciencewithjazz5854 3 ปีที่แล้ว +7

    Josh your songs and teaching are excellent, you are doing something no one else has done in my life: inspiring me to become a Data scientist as well as a composer

    • @statquest
      @statquest  3 ปีที่แล้ว +3

      Wow! That is awesome! BAM! :)

  • @Neoclassicalmaese
    @Neoclassicalmaese 5 ปีที่แล้ว +38

    I don't think I have ever clicked on the subscribe button that fast. Absolutely amazing

  • @ludelaire
    @ludelaire 10 หลายเดือนก่อน +1

    Josh, seriously, thanks for all these videos. My ML journey is smoother thanks to them.

    • @statquest
      @statquest  10 หลายเดือนก่อน

      Glad you like them!

  • @mostinho7
    @mostinho7 4 ปีที่แล้ว +5

    Done thanks
    We take the square to make all the errors positive (we want to find the total error of the points from the line)
    We want to find the optimal values for a and b in the equation of a line that minimize the sum of errors squared. We can express the sum of squares as a function of a and b and take the derivative to optimize it
    5:45
    We find the slope that minimizes the error by finding the minima of the multi variable function (variables are a,b)
    7:30

  • @asghaznavi
    @asghaznavi ปีที่แล้ว +1

    Hello Josh, Thank you for sharing. Every time I sign in, I learn something new from you. Fantastic presentation . Stay blessed.

    • @statquest
      @statquest  ปีที่แล้ว

      Thank you! You too!

  • @daiannehofig3311
    @daiannehofig3311 4 ปีที่แล้ว +6

    Your way to explain these abstract concepts is simply AMAZING!!!! Thank you so much for these incredible videos!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you very much! :)

  • @uchuhikari9292
    @uchuhikari9292 3 ปีที่แล้ว +1

    I have watched and read so many articles but this video explains the use of sum of squared errors and why its important. Thank you!!!

  • @_aft
    @_aft 4 ปีที่แล้ว +57

    It literally only took me 15 seconds to subscribe because of his unique 15 second intro

    • @statquest
      @statquest  4 ปีที่แล้ว +2

      That's awesome! :)

    • @balajichandrasekaran6312
      @balajichandrasekaran6312 3 ปีที่แล้ว

      @@statquest i think you should add fitting a curve to data in this playlist

  • @vincent3542
    @vincent3542 3 ปีที่แล้ว +2

    bro im appreciate every single videos that you've made, i just want to say thanks a ton with not skip ads in your videos, love from indonesian

    • @statquest
      @statquest  3 ปีที่แล้ว

      I appreciate that!

  • @munny0607
    @munny0607 3 ปีที่แล้ว +4

    This is absolutely fantastic! I am so glad that I found this channel on the TH-cam while I am doing the data science self study. I am now understand the concept of OLS which stress me out in a week time before I found this video. Big thanks!

    • @statquest
      @statquest  3 ปีที่แล้ว +1

      I'm glad it was helpful! :)

  • @ramkotha4726
    @ramkotha4726 4 ปีที่แล้ว +4

    Never excited more than after watching this video. Truly intuitive and amazing intro to linear regression.

    • @statquest
      @statquest  4 ปีที่แล้ว +1

      Thank you! :)

  • @imranullah7355
    @imranullah7355 3 ปีที่แล้ว +1

    What a teaching style... 200% which I was searching about...
    Exellent work

    • @statquest
      @statquest  3 ปีที่แล้ว

      Thank you very much! :)

  • @gothams1195
    @gothams1195 3 ปีที่แล้ว +1

    I'm new to data science, you just nailed it ....amazing explanation...after so many videos...finally understood what the heck Linear regression is ...Thank you so much...

  • @moneyman2200
    @moneyman2200 5 ปีที่แล้ว +1

    I've read a few undergrad texts and none of them actually explain the origins of the idea behind least squares. At least not in a simplified visual form, you're usually just explained the problem and slapped with the simple linear model and then the generalized version....This gives some insight into the motivation behind this technique. Thank you for donating you're time to such a altruistic cause. You a real one!

    • @statquest
      @statquest  5 ปีที่แล้ว

      Thank you! :)

  • @akeithkira
    @akeithkira 4 ปีที่แล้ว +2

    OMG !! You really have the best in explaining this concept which most books just want to show how good their English are.

  • @halilibrahimcetin9448
    @halilibrahimcetin9448 2 ปีที่แล้ว +1

    Awesome. I am screaming with happiness. Thanks Statquest. Intuition you conveyed to us priceless.

  • @kawaiihellen2285
    @kawaiihellen2285 2 ปีที่แล้ว +1

    Your videos are helping me write my thesis because I don't have a stats background and went into a science heavy masters. this is just the best!!!!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Good luck! :)

  • @reginango9009
    @reginango9009 3 ปีที่แล้ว +6

    This video made me stop crying from stress of barely understanding anything in my class. Thank you

    • @statquest
      @statquest  3 ปีที่แล้ว

      Glad it helped!

    • @bigvinweasel1050
      @bigvinweasel1050 3 ปีที่แล้ว +1

      Right?! This channel is so underrated, we have to change that!

    • @statquest
      @statquest  3 ปีที่แล้ว

      @@bigvinweasel1050 Wow! Thank you!

    • @bigvinweasel1050
      @bigvinweasel1050 3 ปีที่แล้ว

      @@statquest I'm serious! If you ever need anything done on Python for content - I would be more than happy to write it out as clearly and as elegantly as I can so you can use it for content.

  • @avishekdey1943
    @avishekdey1943 4 ปีที่แล้ว +13

    I never understood why we needed to plot a line. Now I do. It is amazing

  • @avadhsavsani1148
    @avadhsavsani1148 2 ปีที่แล้ว +2

    What a legend you are! No words to express my gratitude. You are a blessing to everyone wanting to learn these concepts! Wish you good health and loads of happiness. :)

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Thank you!

  • @divinity1170
    @divinity1170 5 ปีที่แล้ว +11

    This is the real teaching. Respect

  • @kushbhomawat8722
    @kushbhomawat8722 2 ปีที่แล้ว +1

    AMAZING VIDEO. MAKES STATS AND MATHS MORE LOGICAL AND REAL

  • @ian.ambrose
    @ian.ambrose 2 ปีที่แล้ว +1

    You have the best teaching skill in the universe.

    • @statquest
      @statquest  2 ปีที่แล้ว

      Wow! Thanks!

  • @pravinsaraswatula5263
    @pravinsaraswatula5263 4 ปีที่แล้ว +7

    StatQuest Team - Thank you so much for all your efforts. For the last few months, I felt like that mouse stuck in a wheel going round and round with concepts as I got deeper into ML. A definite recommendation to everyone and anyone irrespective of their ML proficiency.

    • @statquest
      @statquest  4 ปีที่แล้ว

      Awesome! Good luck with your ML studies! :)

  • @zukofire6424
    @zukofire6424 2 ปีที่แล้ว +1

    Thanks very much for this. I watched it last year when I was looking to change careers. Re watching now that I'm enrolled in some real training. And Wow!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      BAM! Good luck with your course.

  • @danielkhromov9724
    @danielkhromov9724 3 ปีที่แล้ว +2

    Oh my God this is just the best video I've ever seen about Linear Regression! Thank you very much! I subscribed just after the video, please do not stop!

    • @statquest
      @statquest  3 ปีที่แล้ว

      Awesome! Thank you!

  • @TheEternalDao
    @TheEternalDao ปีที่แล้ว +1

    maths is so crazy, the explanation was amazing - the people who figure this stuff out are geniuses

  • @aakashgarg66
    @aakashgarg66 3 ปีที่แล้ว +1

    This is the best tutorial channel ever!!

    • @statquest
      @statquest  3 ปีที่แล้ว

      Thank you very much! :)

  • @gingerl6081
    @gingerl6081 4 ปีที่แล้ว +2

    I think that the Blue Lake in New Zealand has some competition for ~most clarity~. This channel is amazing!!

  • @michaelvogt7787
    @michaelvogt7787 4 หลายเดือนก่อน

    Josh. Ive seen this explanation for near 40 years, always re-watching for someone to explain the approach as well as the instructor who introduced it to me in 1980... your is the best so far.
    But, you got away w some simplification by starting w a 0- slope line, and the calculatiin of the line's value was sort of 'lost' when you lept to non-zero slope lines...
    Jussayin.
    Cheers
    DocV

    • @statquest
      @statquest  4 หลายเดือนก่อน

      Glad it was helpful!

  • @aldikroos6290
    @aldikroos6290 5 ปีที่แล้ว +2

    The best teaching video I have ever seen. What a great work!

    • @statquest
      @statquest  5 ปีที่แล้ว

      Thank you! :)

  • @abhi9029
    @abhi9029 3 ปีที่แล้ว +1

    superb explanation, crystal clear with graphics is good way to comprehend. Thank you for this.

  • @supriyamanna715
    @supriyamanna715 3 ปีที่แล้ว +1

    taken Andrew's course and bought books, but that intro and vibe is the rela into to ML--I learned that the hard way. Thanks for your songs.

    • @statquest
      @statquest  3 ปีที่แล้ว

      :)

    • @supriyamanna715
      @supriyamanna715 3 ปีที่แล้ว +1

      @@statquest hey man, I'd like to request you to kindly make a video on how to become an ML engineer from scratch! I am a self taught aspirant. please make the roadmap for people like us

    • @statquest
      @statquest  3 ปีที่แล้ว

      @@supriyamanna715 To be honest, you could just start at the top of this and work your way down, through the webinars: statquest.org/video-index/

  • @user-cb7it9cv9l
    @user-cb7it9cv9l 3 ปีที่แล้ว +1

    Best and simplest explanation ever !!

    • @statquest
      @statquest  3 ปีที่แล้ว

      Glad you liked it!

  • @nayaksrigovind
    @nayaksrigovind 4 ปีที่แล้ว +4

    This is an amazing video on the intuition behind Fitting lines to data. Loved this video, it gave me a recap on some of the concepts I've learnt years ago and have forgotten.

  • @ian_owuor
    @ian_owuor 2 ปีที่แล้ว +1

    Yes this is exactly what I've been looking for. Great video. It has made my life a lot easier.

  • @lampkanocna6
    @lampkanocna6 ปีที่แล้ว

    I just "discovered" by myself that lines generated by linear regression always passes (M(X), M(Y)) point (which, when thinked about it is quite intuitive) and thus, we can add constriction, that
    b=M(Y)-a*(M(X), which allows to solve the equation for just single varible (slope), instead of two (slope and intercept). Thats for sure basic, but im neverthless proud of myself :D Great channel BTW.

  • @Nakameguro97
    @Nakameguro97 3 ปีที่แล้ว

    The slope explanation gives a good intuitive sense of how to find the best-fit slope and y-intercept for least squares, especially if you have a background in calculus. In contrast, the linear algebra solution of OLS is just that much more shocking/amazing; that the same result can be calculated algebraically for n-space >without< any geometric intuition, without any search in the solution space for slope and y-intercept. Your visual explanation is more intuitive and memorable. The linear algebra approach feels more magical, as I find it harder to remember the derivation.

  • @iktiar
    @iktiar 4 ปีที่แล้ว +3

    your method of teaching is awesome, thank you!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you! :)

  • @kensarmoreto1863
    @kensarmoreto1863 3 ปีที่แล้ว +1

    Thank you for the vid. It was so easy to understand the concept of Least Square using visualization. I will use this as my reference for my demo teaching in stat. Hoping fore more stat videos and data analysis trick & tips...

    • @statquest
      @statquest  3 ปีที่แล้ว

      Glad it was helpful!

  • @maheshgopalakrishnan5072
    @maheshgopalakrishnan5072 4 ปีที่แล้ว +1

    Sir, your explanations are crystal clear. Thank you

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you! :)

  • @franciscoicarocs
    @franciscoicarocs 7 หลายเดือนก่อน +1

    I just wanted to say that you were born to teach.
    The book? Are you kidding me? Perfection.
    I would advise to give the first chapter as free content so everybody can have a taste of your abilities.
    Favorite quote so far: "The Binomial Distribution makes me want to run away and hide. :) "

    • @statquest
      @statquest  7 หลายเดือนก่อน

      Thank you very much! That's a good idea. I wonder how I can do that.

    • @franciscoicarocs
      @franciscoicarocs 7 หลายเดือนก่อน +1

      Favorite new quote just dropped: "the Normal distribution is awesome, and, to be honest, it sort of looks like you..." lol

    • @statquest
      @statquest  7 หลายเดือนก่อน

      @@franciscoicarocs Haha! I'm glad you're enjoying it. I just started (in earnest) to write my next book on neural networks (from simple to start of the art)

  • @MrFredazo
    @MrFredazo 4 ปีที่แล้ว +2

    I've seen many of your videos, they are amazing good stuff!
    I just wanted to point out something in this one: you calculate "b" for the first horizontal line, and then you start rotating it to find the best slope.
    But you never explain WHERE IS THE ROTATION POINT! This is crucial!

    • @MrFredazo
      @MrFredazo 4 ปีที่แล้ว

      I mean, to give the intuition that you can assume any intercept and the rotate using it as the rotation point, and it won't change the result.

    • @statquest
      @statquest  4 ปีที่แล้ว

      Noted.

  • @TheSheekeyScienceShow
    @TheSheekeyScienceShow 3 ปีที่แล้ว +2

    I actually LOVE your video style!

    • @statquest
      @statquest  3 ปีที่แล้ว

      Thank you! :)

  • @amribrahim7850
    @amribrahim7850 3 ปีที่แล้ว +1

    You are an incredible teacher.

    • @statquest
      @statquest  3 ปีที่แล้ว

      Thank you! :)

  • @aakshay8440
    @aakshay8440 5 ปีที่แล้ว +3

    hello, you have done the wonderfull explanation. I loved it.
    and I am requesting you to do a video on assumptions made in linear regression.
    this will help us a lot.

  • @Luxcium
    @Luxcium ปีที่แล้ว

    BAM 😅😅😅🎉 I reached out to the bottom of the _STACK_ Quest (finally) 🎉❤ Wow 😮 I am on this quest to find out where this will stop since I just learned that I must watch the video *Fitting a Line to Data* also know as *Linear Regression* before I can watch the *Gradient Descent Step-by-Step!!!* so that I can watch the video related to *Neural Networks part 2* that I must watch before I can watch the *The StatQuest Introduction To PyTorch...* before I can watch the *Introduction to coding neural networks with PyTorch and Lightning* 🌩️ (it’s something related to the cloud I understand)
    I am genuinely so happy to learn about that stuff with you Josh❤ I will go watch the other videos first and then I will back propagate to that first video... And now I feel like it took me 6 years to find out this wonderful video I can't wait to see it😊

    • @statquest
      @statquest  ปีที่แล้ว

      You finally made it!

  • @techproductowner
    @techproductowner 3 ปีที่แล้ว +1

    Bro you are genius . it just sinks in the mind . .they way you are explaining , Kindly guide me with some youtube channel which explains other concepts related to math's like calculus etc. .in similar way . .or I request you to create them as well from prospective of DS

    • @statquest
      @statquest  3 ปีที่แล้ว

      Thanks! Lots of other people like 3Blue1Brown for math.

  • @dariakrupnova6245
    @dariakrupnova6245 2 ปีที่แล้ว +2

    Please do more of these, I think I will be able to pass my econometrics test thanks to you.

  • @may4081
    @may4081 4 ปีที่แล้ว +2

    Simply explained...just makes it beautiful to watch! Thanks!! :-)

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you! :)

  • @ankuragarwala7558
    @ankuragarwala7558 3 ปีที่แล้ว +1

    Great video on least square method.

  • @lucasbatista8169
    @lucasbatista8169 5 ปีที่แล้ว +1

    Great video! It is admirable the effort you put on teaching...
    Just a suggestion: It would be great if you could put the link of the complementary videos you describe in each video. That way, it is easier to keep on track.

    • @statquest
      @statquest  5 ปีที่แล้ว +2

      Thanks for the tip. I generally try to do that (add the links in the description), but sometimes I forget. If you have time, it would be great if you could post which videos need links to complementary videos in a comment and then I'll take care of the rest.

  • @woodynani4394
    @woodynani4394 4 ปีที่แล้ว +1

    Concise and precise, well done Sir.

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you! :)

  • @alhello_game_of_everything
    @alhello_game_of_everything 7 หลายเดือนก่อน +2

    Wowie kabawie wowie ZOWIE! Im still in highschool! And I understand most fundementals in the video!😊

    • @statquest
      @statquest  7 หลายเดือนก่อน

      double bam!

  • @jasafraga
    @jasafraga 3 ปีที่แล้ว

    I think another reason to take the square error is that it creates an actual geometric square of size of the error (area of the square, A= L*W). Add them all up together to get a 2D representation of the error. Where adding all the absolute error lines is only 1D. Sometimes shapes are easier to visualize. Amazing videos and pedagogy style. Props.

  • @angelmotta
    @angelmotta 2 ปีที่แล้ว +1

    Thanks for this content!!! I am very happy to understand these concepts watching this awesome explanation!

    • @statquest
      @statquest  2 ปีที่แล้ว

      Glad it was helpful!

  • @MONAD_0
    @MONAD_0 2 ปีที่แล้ว +1

    Hey josh, I absolutely love your explanations! It's given me a completely different perspective on how i think about machine learning and made the topics intuitive. I wonder if you can compile some notes for all of the content that can be reviewed in under a day and a mind-map that can be used to put all the pieces together. that would be really AWESOME!

    • @statquest
      @statquest  2 ปีที่แล้ว

      Something like this? app.learney.me/maps/StatQuest

  • @АлексейШаков-ь4и
    @АлексейШаков-ь4и 2 ปีที่แล้ว +1

    Hi, Josh. You are amazing person. Your videos are very helpful to me. Your talant of explaining complicated things simply is magnificent! I hope you will go on and help a lot of people like me.
    But I am a bit confused in some moments, I hope you can help me through this.
    It's about the gragh where we plot sum of squared residuals and different rotation.
    If the derivative=0 it means that the our function is horizontal, isn't it? In my head we just have the horizontal line as optimal line but it cannot be so. Please, clear it up.
    Thank you very much!

    • @statquest
      @statquest  2 ปีที่แล้ว

      The point of rotating the line and showing different sums of the squared residuals was simply to help people understand the concept of the goal of finding the optimal line. However, in practice, we just take the derivative of the function and set it to 0 (just like you said). BAM! :)

    • @АлексейШаков-ь4и
      @АлексейШаков-ь4и 2 ปีที่แล้ว +1

      @@statquest thank you very much! So quick response!
      I am a bit of the middle between “simple explanation” and “complex explanation” so it confused me a bit). You are a great human being! Good luck)

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      @@АлексейШаков-ь4и Thank you! Now, even though we can solve for optimal line by setting the derivative = 0 and solving for the slope and intercept, a more general solution, that works in a lot of different situations, is called Gradient Descent. Gradient Descent is the backbone of Machine Learning and is used in this situation, as well as for Deep Learning and all that fancy stuff. For details on how Gradient Descent works, see: th-cam.com/video/sDv4f4s2SB8/w-d-xo.html

  • @tseckwr3783
    @tseckwr3783 ปีที่แล้ว +1

    Thanks for the video. It was a great refresher.

  • @muksmart1
    @muksmart1 3 ปีที่แล้ว +1

    awesome explanation, best ever explanation, made it look so easy.....

  • @jeanlanz2344
    @jeanlanz2344 9 หลายเดือนก่อน +1

    Great explanation. Thank you. God bless you!

    • @statquest
      @statquest  9 หลายเดือนก่อน

      Thank you!

  • @palakagrawal8856
    @palakagrawal8856 2 ปีที่แล้ว +1

    The best explanation to date!

  • @mustafacakir__
    @mustafacakir__ 2 ปีที่แล้ว +1

    Your method of explanation is great. Please keep uploading tutorials. I would like to see tutorials about Deep Learning and Boosting (XGBoost, Catboost, etc.) algorithms which are popular lately. Thanks.

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      I already have videos on deep learning here: th-cam.com/video/CqOfi41LfDw/w-d-xo.html and XGBoost here: th-cam.com/video/OtD8wVaFm6E/w-d-xo.html All of my videos are organized here: app.learney.me/maps/StatQuest

  • @johnwilson3918
    @johnwilson3918 3 ปีที่แล้ว

    This is a brilliant video. You're a few minutes from explaining how to derive the LR formula. I seem to recall from my high school days - that you work out two partial derivatives (dSum/da - treating 'b' as a constant and then dSum/db treating 'a' as a constant) and equate these to 0 (to find minimum). You should be left with a couple of equations for intercept and slope.

    • @statquest
      @statquest  3 ปีที่แล้ว

      That's exactly right (and I show how at least part of this works in my video on the Chain Rule th-cam.com/video/wl1myxrtQHQ/w-d-xo.html ). However, what I don't like about the LR formula is that it only works in this specific situation. In contrast, Gradient Descent gives us pretty good parameter estimates and works in a million other situations. For more details on Gradient Descent, see: th-cam.com/video/sDv4f4s2SB8/w-d-xo.html

  • @RoRight
    @RoRight 7 ปีที่แล้ว

    Just the right amount of theory and math. You should consider teaching stat for students in health and biological studies.

  • @nikhilsetty3451
    @nikhilsetty3451 6 ปีที่แล้ว +1

    Great video.I love the way how intuitive your videos are! 👍🏻

    • @statquest
      @statquest  6 ปีที่แล้ว

      Thank you! :)

  • @MichaelKlimenko
    @MichaelKlimenko 7 หลายเดือนก่อน +1

    Really good explanation, thank you !

    • @statquest
      @statquest  7 หลายเดือนก่อน

      Thanks!

  • @ayselceferzade8587
    @ayselceferzade8587 2 ปีที่แล้ว +1

    clearly explained! lots of thanks

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Glad it was helpful!

  • @Mohammadreza-Dolati
    @Mohammadreza-Dolati ปีที่แล้ว +1

    thanks a lot for your useful content , ❤ from Iran

    • @statquest
      @statquest  ปีที่แล้ว

      Hello Iran!!! Thank you! :)

  • @Hevletica
    @Hevletica 2 ปีที่แล้ว +2

    Sorry for commenting several times throughout the series, but I would like to point out you should probably move this video + "Linear Regression, Clearly Explained!!!" before ROC/AUC in your ML playlist since you suggest understanding these basics beforehand.

    • @statquest
      @statquest  2 ปีที่แล้ว +2

      Ok thanks!

  • @ling6701
    @ling6701 2 ปีที่แล้ว +1

    Clearly explained indeed. Thank you.

    • @statquest
      @statquest  2 ปีที่แล้ว

      Glad it was helpful!

  • @mohdaslam9092
    @mohdaslam9092 2 ปีที่แล้ว +1

    Best explanation ever!

    • @statquest
      @statquest  2 ปีที่แล้ว

      Wow, thanks!

  • @tagoreji2143
    @tagoreji2143 2 ปีที่แล้ว +1

    Awesome Information.Thank you Sir

  • @hardouthereforaph.d.2525
    @hardouthereforaph.d.2525 3 ปีที่แล้ว +1

    God bless you and these videos. These are so helpful

  • @abhinav9561
    @abhinav9561 4 ปีที่แล้ว

    Hi Josh. Love your videos!! They give the best intuitive explanation. Can't thank you enough :).
    Please make a video on curve fitting for linear equations using normal equations vs using gradient descent. Thank You!

    • @statquest
      @statquest  4 ปีที่แล้ว

      My video on Gradient Descent compares that method to the analytical solution: th-cam.com/video/sDv4f4s2SB8/w-d-xo.html

  • @viethoalam9958
    @viethoalam9958 7 หลายเดือนก่อน +1

    each time i hear your song, i just laugh. you brighten my day!

    • @statquest
      @statquest  7 หลายเดือนก่อน

      bam! :)

  • @yourfriend988
    @yourfriend988 3 ปีที่แล้ว +2

    Now that's a good explanation.

  • @shamsulazhar
    @shamsulazhar 2 ปีที่แล้ว +1

    Amazing clarity.... and I don't just mean the singing.

  • @golamchowdhury4165
    @golamchowdhury4165 2 ปีที่แล้ว

    Great Video! I believe correction needed at 8:09 , it should be "Taking the derivatives of SSR with respect to both slope and intercept ... "

    • @statquest
      @statquest  2 ปีที่แล้ว

      Sure, I should have been a little more careful with my words there.

  • @naughtynoodle3271
    @naughtynoodle3271 5 ปีที่แล้ว +1

    You have the best videos on the internet on Stat & data science.

    • @statquest
      @statquest  5 ปีที่แล้ว +1

      Thank you very much! :)

  • @sweetmaths4213
    @sweetmaths4213 2 ปีที่แล้ว +1

    This is so awesome. I finally get it! Have you written a book?

    • @statquest
      @statquest  2 ปีที่แล้ว

      Yes, I have written a book and it should come out this spring. Subscribe to stay in the loop! :)

  • @christinagiannaros9817
    @christinagiannaros9817 2 ปีที่แล้ว +1

    When a clip about stats starts of with singing that makes you laugh before you start it's a very good thing.

  • @maialso6096
    @maialso6096 3 หลายเดือนก่อน +1

    Wow ! this such good visuals ! Interesting!

    • @statquest
      @statquest  3 หลายเดือนก่อน +1

      Thanks!

  • @AbhiJeevanantham
    @AbhiJeevanantham ปีที่แล้ว +1

    10 videos in I have started dancing to the song at the beginning.

  • @loufadoros20
    @loufadoros20 2 ปีที่แล้ว

    very interesting, i can see also the usage of optimization as a course