Machine Learning Fundamentals: Cross Validation

แชร์
ฝัง
  • เผยแพร่เมื่อ 27 พ.ย. 2024

ความคิดเห็น • 1.5K

  • @statquest
    @statquest  5 ปีที่แล้ว +118

    Correction:
    4:16 KNN should have 10 correct and 14 incorrect.
    NOTE: There has been a debate if we should call the "testing dataset" a "testing dataset" or "validation dataset". In my opinion, this depends on the size of your dataset. We'd all like to have a large dataset that we can divide into three parts: Training, Validation and Testing, but that doesn't always happen in the real world.
    Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

    • @曾成成-d7b
      @曾成成-d7b 5 ปีที่แล้ว +3

      lol I stopped at that point for one minute wondering why it is 10 and 12 for which the sum is not 24

    • @jacksmith870
      @jacksmith870 4 ปีที่แล้ว +21

      tiny bam!!

    • @ahanapal4055
      @ahanapal4055 4 ปีที่แล้ว +1

      Can you clarify what is this "Correct" and "Incorrect" indicating after each testing using different blocks of data?..what is the interpretation when correct:4 ? :( Unable to get it.. :(

    • @statquest
      @statquest  4 ปีที่แล้ว +9

      @@ahanapal4055 The machine learning methods that I am comparing in this video are classifying observations. Since we are training the methods, we know how the observations should be classified in advance. Thus, if the method makes the correct classification, then it is "correct". If the method makes the incorrect classification, then it is "incorrect". Does that make sense?

    • @ahanapal4055
      @ahanapal4055 4 ปีที่แล้ว +1

      @@statquest yes, thanks a lot for the clarification!!

  • @EigenA
    @EigenA 4 ปีที่แล้ว +251

    It’s crazy to think where we would be if every subject had videos this clear and well made.

    • @statquest
      @statquest  4 ปีที่แล้ว +6

      Thanks!

    • @Movewithkhu
      @Movewithkhu 2 ปีที่แล้ว +14

      its crazy to think where i would be if i j had access to the net in my growing years instead of my abusive dad

    • @angelika87
      @angelika87 ปีที่แล้ว +4

      we can't control that assholes brought us into the world
      but thank goodness we have videos now to get us where we need to be

    • @michaellai5549
      @michaellai5549 ปีที่แล้ว +1

      @@Movewithkhu I can understand your feelings. All I could say is to let you know you are not alone.

  • @pravin8419
    @pravin8419 4 ปีที่แล้ว +297

    Dear sir/ Dear Josh,
    Your StatQuest series is brilliant to say the least. The internet is these days flooded with ML tutorials that teach how to run algorithms such as logistic regression or KNN using softwares, or with the lengthy incomprehensible mathematics that explains those algorithms. Yours is one of the rare materials that explains the philosophy! Philosophy, that is the deal for humans, not just feeding numbers and generating more numbers using a machine. Thanks a lot for giving me clarity on how exactly to use cross validation, and for clearing some of the nagging doubts from my tiny,less intelligent brain .

    • @statquest
      @statquest  4 ปีที่แล้ว +17

      Hooray! I'm glad you like my video. :)

    • @danielniels22
      @danielniels22 3 ปีที่แล้ว +2

      yes, that relates to me very much. I'm now in a Data Science bootcamp, and they just explain the maths behind each of algorithms incomprehensibly. they said that the point is just know the little math, because on the field, we just import the sklearn library, and try every model, every algorithm, which one gives the best prediction....
      after listening to their statements like that, it makes me wondering. "hmm, i'm afraid that they are probably true, that there is no point at all to learn the math behind these ML Algorithms, because they just import module, choose each of existing algorithm, and done"

    • @BigAsciiHappyStar
      @BigAsciiHappyStar 5 หลายเดือนก่อน +1

      these so-called lengthy incomprehensible mathematics should be paraphrased into rap songs 😂

  • @Kenkoopa44
    @Kenkoopa44 8 หลายเดือนก่อน +3

    I can read books and listen to professors for hours about a subject like this and still not understand it... then I watch a 6 minute video and it is crystal clear. Thank you StatQuest!!!!!!!!

    • @statquest
      @statquest  8 หลายเดือนก่อน

      bam! :)

  • @Bananabanananax
    @Bananabanananax 8 วันที่ผ่านมา +1

    My professor spent 2 classes (2.5hrs) trying to explain this. You did it clearer in this short video!

    • @statquest
      @statquest  8 วันที่ผ่านมา

      Bam! :)

  • @InfinitelyScrolling
    @InfinitelyScrolling 4 ปีที่แล้ว +620

    My friends find me lame when I say "I learn machine learning from a guy who sings and teaches" .
    Lol they are missing out.

    • @statquest
      @statquest  4 ปีที่แล้ว +21

      That's funny. :)

    • @lzy909axym5
      @lzy909axym5 4 ปีที่แล้ว +9

      Tiny Bam!

    • @nkristianschmidt
      @nkristianschmidt 4 ปีที่แล้ว

      yup joshuastarmer.bandcamp.com/track/love-song

    • @kishorekumard4911
      @kishorekumard4911 3 ปีที่แล้ว +2

      I think he is got the world's best teaching skills. Trust me learning ML is not easy unless you are interested. Even if you are not at least you will not feel sleepy in his lectures.

    • @MrAdhito
      @MrAdhito 3 ปีที่แล้ว +2

      Angry bam ! 😤

  • @CarinaGrady
    @CarinaGrady 2 ปีที่แล้ว +17

    I hardly ever comment on TH-cam videos, but I just wanted to say that this has been a TREMENDOUS help and I absolutely loved the breakdown, logic, humor, and visuals. Thank you for for making this brilliant video!

  • @TimVerdouw-itmobilesupport
    @TimVerdouw-itmobilesupport 5 ปีที่แล้ว +75

    The best example so far. After watching this, my lecture's notes made sense.

    • @Mali97779
      @Mali97779 4 ปีที่แล้ว +6

      Same case with me. Double Bam! :)

    • @PunmasterSTP
      @PunmasterSTP 8 หลายเดือนก่อน +1

      How'd the rest of your class go? Was it a...Bam!?

  • @etornamtsyawo6407
    @etornamtsyawo6407 2 ปีที่แล้ว +2

    Who also liked the video upon hearing the short musical interlude at the beginning?! Your voice is very soothing. I’m preparing for an exam in about 2hours and needed to understand this concept. Thanks a lot!
    Every single info in this video came in my exams! I wrote with understanding!!! Thanks!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Thank you very much! :)

  • @2NormalHuman
    @2NormalHuman 2 ปีที่แล้ว +28

    i like how you're trying to make your videos not only educational but also entertaining

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Thanks!

    • @w花b
      @w花b 3 หลายเดือนก่อน +1

      @@statquest double bam

  • @shobhitsadwal756
    @shobhitsadwal756 3 ปีที่แล้ว +3

    there are a lot of teachers that have knowledge , but of them 80 percent dont know how to teach , 10 percent knows but dont care, 8 percent really care but are not succinct with their methods but 2 percent knows how to teach clearly and precisely in layman terms , they can teach anyone with their style , You are in that 2 percent category . Respect >>>>>.

    • @statquest
      @statquest  3 ปีที่แล้ว

      Thank you very much! :)

  • @miguelalejandro7045
    @miguelalejandro7045 3 ปีที่แล้ว +3

    I just don't understand how somebody could dislike this video. It has everything I've ever wanted teaching to be.

  • @sushantkhapekar599
    @sushantkhapekar599 5 ปีที่แล้ว +3

    !!! BAM !!! Finally I found a TH-cam trainer who shares knowledge the way I would like to learn... A big thank you :)

  • @profetspurvius913
    @profetspurvius913 10 หลายเดือนก่อน +3

    If I pass my machine learning exam next week it will literally be all thanks to you. Either my book is completely unreadable or I'm stupid, but your videos make so much sense and I finally feel like I actually get the stuff you're talking about. Thank u!!

    • @statquest
      @statquest  10 หลายเดือนก่อน +1

      Thanks! By the way, I have a book covering this same material - so check it out if you need extra help: statquest.org/statquest-store/

    • @profetspurvius913
      @profetspurvius913 10 หลายเดือนก่อน +2

      @@statquest I PASSED!!! THANK YOU SO MUCH!!!! :D

    • @statquest
      @statquest  10 หลายเดือนก่อน +1

      @@profetspurvius913 Congratulations!!! TRIPLE BAM!!!

  • @deanvik6317
    @deanvik6317 4 ปีที่แล้ว +13

    Josh Starmer, you are the savior of my PhD! I rarely do this, but I'm gonna buy a shirt... THANK YOU!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Hooray! And thank you very much! :)

  • @gaurangikatharya
    @gaurangikatharya 4 ปีที่แล้ว +3

    Oh my sweet lord! I couldn't have ever imagined that someone can teach data science concepts soooooooo interestingly and easily. I never ever comment!! But you made me do this first time in my life

    • @statquest
      @statquest  4 ปีที่แล้ว +1

      Thank you very much! :)

  • @gurguer
    @gurguer 4 ปีที่แล้ว +12

    I cannot believe how you put all these complicated theories into such an explicit way!!! Wonderful channel!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you very much! :)

  • @aliciachen9750
    @aliciachen9750 5 ปีที่แล้ว +46

    probably some of the best explained stats videos i've seen on youtube. thank you josh for constantly providing us with material that we can actually understand 0:)

    • @statquest
      @statquest  5 ปีที่แล้ว +1

      Thank you very much. :)

  • @adityasahu96
    @adityasahu96 3 ปีที่แล้ว +6

    my teacher took almost 2 hours to explain this and i didn't even get it! THANK YOU I got it in under 10 Minutes !!

    • @statquest
      @statquest  3 ปีที่แล้ว +1

      Glad it helped!

  • @mohammedshkokani9631
    @mohammedshkokani9631 3 ปีที่แล้ว +1

    one of the best videos ever i have watched, made machine learning clear only in 1.17 min of the video, you man are very great

    • @statquest
      @statquest  3 ปีที่แล้ว

      thank you very much! :)

  • @atifayaz3495
    @atifayaz3495 4 ปีที่แล้ว +6

    When I am gonna make my videos, you'll be my inspiration. The way you take us through the video is like a guide taking us through a guided meditation.
    Edit : and at the end it make us feel satisfied and delightful.

    • @statquest
      @statquest  4 ปีที่แล้ว +3

      Wow, thank you!

  • @knads98
    @knads98 ปีที่แล้ว +5

    I have a ML quiz on monday and was so worried about not grasping these concepts in time - your videos are super clear and helpful and genuinely enjoyable to watch! Thank you StatQuest with Josh Starmer

    • @statquest
      @statquest  ปีที่แล้ว

      Hooray!!! Happy to help.

  • @Jenna-iu2lx
    @Jenna-iu2lx 2 ปีที่แล้ว +3

    I finally understand machine learning and it's better explained than in class. You're the best, BAM!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Happy to help!

  • @im4485
    @im4485 ปีที่แล้ว +1

    Josh, what is your own way of learning new things? Your ability to simplify things so well shows that you have a deep understanding of the subject.

    • @statquest
      @statquest  ปีที่แล้ว +8

      I just read everything I can about a topic and then re-read and re-read and re-read until I learn. The trick is that I never give up.

  • @williamzheng5918
    @williamzheng5918 5 ปีที่แล้ว +11

    Clearly explained, great video! Maybe you skip this on purpose due to its complexity, but there is a small caveat.
    At the end you mention 'parameter tuning' using cv, these 'parameters' are called hyperparameters, different as model parameters. In order to do so, you need to further split the data into train/validation/test set, and only use train/validation part for tuning, while still having the test set for a final estimation of model performance.

    • @ahmedatta6508
      @ahmedatta6508 4 ปีที่แล้ว +1

      please , I have question regarding cv for ridge regression , I will try different (lamnda) in each fold for example (10 different values for lamnda ) with ten folds or should I try each (lamnda) I need to test with all 10 fold and compare in the final between them

  • @buihung3704
    @buihung3704 ปีที่แล้ว +2

    Why can't most other lecturers on this world teach like you, why can't MY lecturers teach like you, im crying now :(((( if I have to learn Stats/AI/DL/... every single day for the rest of my life, but if it's you who taught us, it's well worth it.

  • @satish9367
    @satish9367 4 ปีที่แล้ว +5

    I loved the Tiny Bam, Sir! You Patience to go slow tell us that you have a low bias; meaning, it's easy for non-native English folks to understand the concepts clearly. Keep up the good work. I will stalk your channel and like all the videos you have every made by the end of this week. Thank you Again.

  • @krishnakanchibhatta6161
    @krishnakanchibhatta6161 5 ปีที่แล้ว

    I have completed Applied Machine Learning course from a University in US. The concepts I learned there are being reinforced after watching your Video Josh. Thank you so much for putting out these videos.

  • @carolinegh601
    @carolinegh601 5 ปีที่แล้ว +5

    I can't imagine how my life would be without these videos! Thanks a lot!

    • @statquest
      @statquest  5 ปีที่แล้ว

      Hooray! I'm glad the videos are helpful. :)

  • @vivekd9563
    @vivekd9563 3 ปีที่แล้ว +221

    This guy is legend better than top university professors 😆

    • @statquest
      @statquest  3 ปีที่แล้ว +9

      Thanks!

    • @j.castro7355
      @j.castro7355 ปีที่แล้ว +10

      ​@@statquest As a student at a top 10 uni in the world, I can confirm these are facts 😂

    • @hieuthepunk
      @hieuthepunk ปีที่แล้ว

      ​@@j.castro7355really? 😂 Then i will no longer have an excuse that i don't have access to the best education anymore.
      Let's grind hard

    • @arenashawn772
      @arenashawn772 11 หลายเดือนก่อน +5

      Couldn’t agree more. After going through machine learning course materials on virtually every educational platform like coursera, simplilearn, EdX from top universities and companies from Harvard to Google, I think none of them remotely reaches the clarity and no-bushitness here. BAM!!!!

    • @craigrodrigues3435
      @craigrodrigues3435 8 หลายเดือนก่อน +1

      Facts!

  • @f.s.8443
    @f.s.8443 2 ปีที่แล้ว +2

    These videos do such an amazing job summarizing concepts that my professor has spend hours trying to explain. I was pulling my hair in frustration at his teaching until I encountered your videos. These videos are like a breath of fresh air to my knowledge and understanding of data science. A huge thanks to you Josh Starmer! Keep up the amazing work!

    • @statquest
      @statquest  2 ปีที่แล้ว

      Glad to help!

    • @joeymediauk
      @joeymediauk ปีที่แล้ว

      The amount of BS they try to get you to wade through when explaining concepts
      E.g. Instead of starting with a massive equation and the formal explaination, a simple intuitive explainatiom, then relate that to the formal process

  • @GeoScientist121
    @GeoScientist121 3 ปีที่แล้ว +3

    Hey Josh! This is the first time I'm watching your videos and I love the way you teach: pausing for a second before saying the next sentence. It gives time for the listener to digest what you said before! Love it!

    • @statquest
      @statquest  3 ปีที่แล้ว +1

      Awesome! Thank you!

  • @tarekal4847
    @tarekal4847 5 ปีที่แล้ว +4

    This is fantastic, I usually don't comment, but felt I had to from how well done this explanation is. Thank you for taking the time to make this

    • @statquest
      @statquest  5 ปีที่แล้ว

      Thank you so much! :)

  • @warrenb7450
    @warrenb7450 3 ปีที่แล้ว +2

    Before watched Statquest videos, I NEVER believe I'd like numbers, statistics... Now I believe I could be a data scientist if I keep watching these videos:-)

  • @shamshersingh9680
    @shamshersingh9680 3 ปีที่แล้ว +2

    NO words for you Mr Josh, hats off!! You make all the concepts so easy to learn in such a short time.

  • @asfandnasar
    @asfandnasar 5 ปีที่แล้ว +1

    this Guy is a G. Just found his channel. one of the Best series of lectures out there. Thanks.

    • @statquest
      @statquest  5 ปีที่แล้ว

      Thank you!!! :)

  • @SUREE37
    @SUREE37 6 ปีที่แล้ว +408

    This is the awesome video. TRIPLE BAM!!!!!

    • @statquest
      @statquest  6 ปีที่แล้ว +21

      Hooray!!! :)

    • @jcourn1
      @jcourn1 5 ปีที่แล้ว +2

      What's the difference between a machine learning method and machine learning model? Is a model applying a method to a specific dataset therefore modeling how it behaves? Will you make a statquest about what is a model??? That's a triple question mark bam! Love your videos! Thank you!

    • @yashasvibhatt1951
      @yashasvibhatt1951 4 ปีที่แล้ว

      @@jcourn1 do you still need an answer or should I just skip it, since you posted it an year ago.

    • @jcourn1
      @jcourn1 4 ปีที่แล้ว

      @@yashasvibhatt1951 thanks for replying! Sure! What's the implication of the terms machine learning model?

    • @yashasvibhatt1951
      @yashasvibhatt1951 4 ปีที่แล้ว +9

      @@jcourn1 A Machine Learning Method is a way of teaching a machine using the data-driven approach.
      A Machine Learning Algorithm is a set of rules or a list of steps or a procedure to teach the machine using that methodology.
      A Machine Learning model is what we have received after applying the algorithm on a certain dataset to teach our machine. It represents what was learned by machine using the algorithm.
      Hope that helps 🙂🙂🙂

  • @sarahnourse9906
    @sarahnourse9906 3 ปีที่แล้ว +1

    My face hurts from smiling so much at these! Thanks so much! Your videos are so helpful for me to understand my new job!

    • @statquest
      @statquest  3 ปีที่แล้ว

      BAM! And congratulations on the new job. :)

  • @rakeshranjan9728
    @rakeshranjan9728 4 ปีที่แล้ว +6

    Dude your explanations and visuals are just perfect.
    I will watch each and every video uploaded by you for sure.

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you very much! :)

  • @susandelgado7965
    @susandelgado7965 4 ปีที่แล้ว +1

    Words fail me. Mr. Starmer, you have a true gift for teaching. If you are ever in Amsterdam, the drinks are on me.....

    • @statquest
      @statquest  4 ปีที่แล้ว

      Hooray! Thank you very much! :)

  • @tymothylim6550
    @tymothylim6550 3 ปีที่แล้ว +9

    Thank you very much for this video, Josh! The use of visuals to explain cross validation really helps! I learnt a lot through this video about the fundamental basis behind cross validation as well as the extreme case of Leave-One-Out!

  • @dollishsilverdreams
    @dollishsilverdreams ปีที่แล้ว +1

    One of the most wholesome channels on here; absolutely love it, I'm getting motivated instantly !

  • @tanhua955
    @tanhua955 5 ปีที่แล้ว +3

    This is the best stat channel. Extremely simple to understand. Thank you!!!

    • @statquest
      @statquest  5 ปีที่แล้ว +1

      Thank you! :)

  • @COSMOPOLITANWORLD
    @COSMOPOLITANWORLD 2 ปีที่แล้ว +1

    You're the best teacher ever! Your videos motivate me not to give up in Data Science!! Thanks a lot!!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Thanks! I'm glad they're helpful.

  • @giiidget
    @giiidget 4 ปีที่แล้ว +17

    I find this crazy that before and after every (very expensive) class now I'm looking up the same info here.... I'm a top-down learner though and my class seems to be built around bottom up learners. Thank you soooo much - yes I'll get a hoodie! #statquestforlyfe

    • @statquest
      @statquest  4 ปีที่แล้ว +2

      BAM! I'm glad the videos are helpful! :)

  • @MadhushreeSinha
    @MadhushreeSinha 4 ปีที่แล้ว +2

    I just can't explain how much i love your teaching!!! the songs refreshen my mind every time...

  • @ollysalanson9452
    @ollysalanson9452 3 ปีที่แล้ว +3

    I'm so glad I have found your channel, extremely well explained and I was in a good mood from the start because of the epic song.

    • @statquest
      @statquest  3 ปีที่แล้ว

      Awesome, thank you!

  • @netviz8673
    @netviz8673 ปีที่แล้ว +1

    1:18 ML methods, Logistic regression, K nearest neighbours, Support vector machines. Cross validation allows us to compare different ML methods and get a sense of how well they will work in practise.
    We need two things to do with the data collected.
    i) estimate the parameters for machine learning method(training the machine learning method)
    ii) test the machine learning method(evaluation of the model)
    4 fold cross validation,leave one out cross validation, 10 fold cross validation(commonly used), tuning parameter

  • @WalkandTalk30
    @WalkandTalk30 4 ปีที่แล้ว +3

    Best concept descriptions I have found yet. Explained over-fitting in a better way that my textbook or course have. Hoping for a linear algebra course! Thanks!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Awesome, thank you!

  • @tameemshahid8554
    @tameemshahid8554 4 ปีที่แล้ว +1

    Just saying I've watched only 3-4 of your videos and you have me hooked! Best, concise and simple explanation!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Wow, thanks!

  • @rs-tarxvfz
    @rs-tarxvfz 4 ปีที่แล้ว +3

    Am I the only one who thinks that show casing 2 talents at same time is becoming new phenomenon?

  • @castro_hassler
    @castro_hassler 4 ปีที่แล้ว +2

    Good vid, this is k fold cross validation, the notion of a cross validation set involves dividing your data even further for hyper parameter tuning.

  • @dropfiremusic4752
    @dropfiremusic4752 5 ปีที่แล้ว +3

    the easiest video on the Internet to understand this topic :)

  • @endaronelprime6255
    @endaronelprime6255 3 ปีที่แล้ว +1

    Dude I came to understand the difference between Cross Validation and Leave one out, instead I found that i completly missunderstood cross validation. Happy that i had a big breakthrough, i decided to watch the video to the end. And DOUBLE BAM in one sentence you explained what leave on out is.
    -> Subscribed!

    • @statquest
      @statquest  3 ปีที่แล้ว +1

      Hooray! I'm glad video was helpful.

  • @michelm1623
    @michelm1623 5 ปีที่แล้ว +3

    some scientists should take example as you just explain , congratulations JOSH !

  • @hoangminhthai4055
    @hoangminhthai4055 ปีที่แล้ว +1

    - We have to divide our intro training set and validation sets.
    - But which data we will choose as a training set or validation set ---> cross-validation: automatically split our set.
    - 4-fold cross-validation is to divide our sets into 4 parts.
    - We can tune the parameter of the number of nodes

  • @hanjiang1106
    @hanjiang1106 5 ปีที่แล้ว +3

    your channel is the best channel I've seen in TH-cam!!! Look forward for more videos!!!

    • @statquest
      @statquest  5 ปีที่แล้ว

      Thank you so much!!! :)

    • @hanjiang1106
      @hanjiang1106 5 ปีที่แล้ว

      would you like to talk about cost complexity pruning when you have time? thank you!

  • @malinkata1984
    @malinkata1984 3 ปีที่แล้ว +1

    It's almost 3am and I need to go to sleep, but I can't stop watching your videos! They are awesome. Thank you so much!

    • @statquest
      @statquest  3 ปีที่แล้ว

      BAM! :)

    • @malinkata1984
      @malinkata1984 3 ปีที่แล้ว

      Directly went to BAM.. no need to even think about SAM :D Referring to samtools here..

  • @mandanapourzadi8848
    @mandanapourzadi8848 5 ปีที่แล้ว +4

    BAAAAAAAM!!! That was awesome expression. Wish you had practical examples worked on MATLAB or Phyton.

  • @hardlight8743
    @hardlight8743 2 ปีที่แล้ว +1

    I always wanted to learn ML and don't know where to start , You made my dreams come true , Thank you alot ❤

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Thank you!

  • @sissyspiritosanto8807
    @sissyspiritosanto8807 4 ปีที่แล้ว +5

    What you do is simply amazing!!!!! Thank you!!!! Just a tiny question: when you divide your data into blocks which you use as training set, do you use each different block for a different algorithm, or do you use the same training data to train different algorithms? Thank you again!

    • @statquest
      @statquest  4 ปีที่แล้ว +7

      If you split your data into blocks 1, 2, and 3, then you would train all of your models on blocks 1 and 2 and test with 3. Then you would train all of your models on blocks 1 and 3 and test with 2 and then you would train all of your models on blocks 2 and 3 test with 1. bam.

    • @sissyspiritosanto8807
      @sissyspiritosanto8807 4 ปีที่แล้ว +2

      @@statquest Great Josh!!! Thank you very much! This channel is a life saver!

  • @dhruvnivatia9222
    @dhruvnivatia9222 4 ปีที่แล้ว +1

    Your teaching style is just awesome. You explained everything in simple words and great English accent which is easily understandable. You got a new subscriber

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you! 😃

  • @KathySolita
    @KathySolita 3 ปีที่แล้ว +47

    ᵗⁱⁿʸ ᵇᵃᵐ

  • @anilsarode6164
    @anilsarode6164 4 ปีที่แล้ว +1

    I use a tenfold cross-validation method in the ridge and lasso regression implementation in my master thesis on SONAR/RADAR imaging. At that time I read a lot about Cross-validation to grasp the concept. Today your video help me to brush up the concept again. Thanks a lot. and feel bad that time I did not found this channel.

    • @statquest
      @statquest  4 ปีที่แล้ว

      I'm glad the video was helpful! :)

  • @sakshisingh2462
    @sakshisingh2462 4 ปีที่แล้ว +4

    I watched 50% for ML and 50% for the BAMS!!

  • @Privacy-LOST
    @Privacy-LOST 5 ปีที่แล้ว +1

    I will never stop thanking you... And it will never be enough

  • @Smurfje94
    @Smurfje94 5 ปีที่แล้ว +3

    Thank you for the video! Do we need to perform a loss function?

    • @statquest
      @statquest  5 ปีที่แล้ว +2

      The machine learning method you use might involve a loss function, but, otherwise, you don't need to use one.

  • @omprakash007
    @omprakash007 5 ปีที่แล้ว +2

    Firstly i like to thank you for explaining these concepts in such a crystal clear manner , this is one of the best video i ever witnessed. second, i request you to please make some video on backpropagation and some tedious concepts of M.L.
    once again thank you.

  • @suhyunkim3972
    @suhyunkim3972 6 ปีที่แล้ว +173

    lol at tiny bam

  • @sg7031
    @sg7031 ปีที่แล้ว +1

    first time watching your video for an exam, really felt the BAM moment! 👏
    you're a wonderful teacher, please keep up the good work!

    • @statquest
      @statquest  ปีที่แล้ว

      Thank you! 😃

  • @dhinesh534
    @dhinesh534 4 ปีที่แล้ว +3

    Finally, this youtube algorithm take me here.

  • @rizachahid2162
    @rizachahid2162 3 ปีที่แล้ว +1

    almost 2 years that I was working machine learning and I just understand why and what is train/test set THANKS TEACHER

  • @AnirbanDasgupta
    @AnirbanDasgupta 5 ปีที่แล้ว +4

    Given the 1000th like to this video :)

  • @khaingsuthway932
    @khaingsuthway932 3 ปีที่แล้ว +1

    Your clips really save me from my lack of basic knowledge and fear of machine learning. Horay........... Triple Bam.!!!!

    • @statquest
      @statquest  3 ปีที่แล้ว

      Glad to help!

  • @Ikankinkun
    @Ikankinkun 6 ปีที่แล้ว +6

    BAM that subscribe button!

    • @statquest
      @statquest  6 ปีที่แล้ว

      Double BAM!!! Thank you!

  • @ll-shellshock-ll1544
    @ll-shellshock-ll1544 10 หลายเดือนก่อน +1

    Love how he teaches us like we are 6 year olds haha. You earned yourself a subscriber. Thank you for your videos!

    • @statquest
      @statquest  10 หลายเดือนก่อน

      Thanks!

  • @lizimoodyspecter7281
    @lizimoodyspecter7281 5 ปีที่แล้ว +4

    This shit is legit.

  • @arashmahmoudian
    @arashmahmoudian 11 หลายเดือนก่อน +1

    Thank you Josh Starmer for your excellent work, I personally enjoy watching your tutorials.

    • @statquest
      @statquest  11 หลายเดือนก่อน

      Thank you!

  • @mishtimaithli
    @mishtimaithli 2 ปีที่แล้ว +1

    That clarity I get after watching your videos... ! BIG BAM!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      Thank you!

  • @artemkamov7090
    @artemkamov7090 5 หลายเดือนก่อน +1

    This is incredible! I had no idea it’s possible to explain these things so easily!

    • @statquest
      @statquest  5 หลายเดือนก่อน

      Thanks!

  • @sloperspinches3122
    @sloperspinches3122 4 ปีที่แล้ว +2

    Thank you for simplifying cross-validation concepts. It helps me a ton for my masters. Again, thank you!

    • @statquest
      @statquest  4 ปีที่แล้ว

      Glad it was helpful!

  • @jonathanuis
    @jonathanuis 4 ปีที่แล้ว +2

    Josh your songs are so relaxing, it is like I´m stressed out, then let´s watch a StatQuest, they always start with those funny songs.

    • @statquest
      @statquest  4 ปีที่แล้ว

      Hooray!! Thank you very much.

  • @Dodoakakakadu
    @Dodoakakakadu 5 ปีที่แล้ว +1

    I struggled with the concept for a bit, it became instantly clear to me!
    Thanks a lot.

  • @SurrenderPink
    @SurrenderPink 4 ปีที่แล้ว +1

    Just as I was getting seriously over my head with K Fold CV for a Numerai model... Lo and behold! My favorite statistical troubadour, Josh, appears to light the way. Bam to every which way you can validate it!

  • @littleKingSolomon
    @littleKingSolomon 4 ปีที่แล้ว +1

    You're amazing. Thanks a lot. With statquest, machine learning is child's play. Thanks Josh, your efforts very much appreciated

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you! :)

  • @naomimichiko
    @naomimichiko 4 ปีที่แล้ว +1

    I have been struggling with this concept but you cleared it within 6 mins wow thank you!!!

  • @mps6934
    @mps6934 5 ปีที่แล้ว +3

    Amazing! Explains basic concepts very well, wish I had seen this video when I had no clue about training/testing etc.

    • @statquest
      @statquest  4 ปีที่แล้ว

      Better late than never. :)

  • @iftrejom
    @iftrejom 3 ปีที่แล้ว +1

    BAM! Thank you very much for this valuable piece of content. Cross validation is as clear as water to me now.

  • @OnlyABlemish
    @OnlyABlemish 2 ปีที่แล้ว

    These videos are so helpful for me. One thing I'm running into though is understanding cross validation for time series data. When to apply a gap to the folds, when to use an expanding versus sliding window, etc. There isn't much quality info out there easily explaining the process. Might be a good future video idea!

    • @statquest
      @statquest  2 ปีที่แล้ว +1

      I'll keep that in mind!

  • @JoyceGem
    @JoyceGem ปีที่แล้ว +1

    New subsciber here, I can't believe I'm late to this channel. THANK YOU SO MUCH. You have explained it in the clearest way possible!

    • @statquest
      @statquest  ปีที่แล้ว

      Thank you very much! :)

  • @myramacarulay8715
    @myramacarulay8715 4 ปีที่แล้ว +1

    Your videos are very helpful, much practical and simple way to explain concepts. I learned more in your videos than my grad lecture notes. Thank you so much!

  • @hareezvizard9233
    @hareezvizard9233 3 ปีที่แล้ว +1

    thanks bro. you help me a lot. now I understand what is testing, training, cross validation, bias and other lingos. i read many articles, but I don't understand a thing when they use this kind of words. thank you very much. from this, I also know what, why, how training and testing thing. thanks a lot. idk what to say anymore.

    • @statquest
      @statquest  3 ปีที่แล้ว

      Glad my videos helped!

  • @classyman5627
    @classyman5627 4 ปีที่แล้ว +1

    Great explanation for K fold....cross validation....btw this was explained much better than an online virtual live session I attended.....

  • @alizahidraja
    @alizahidraja 5 ปีที่แล้ว +1

    topics you can make more videos on, this may include things you have already worked on
    Trees
    -Trees for classifcation
    -Building trees
    -Gini impurity
    -Entropy
    -Information gain
    Ensemble methods
    -Tree bagging
    -Random forests
    -Adaboost
    KNN classification
    K-mean clustering
    Linear regression
    Gradient descent optimization
    Overfitting and underfitting
    -Detection of overfitting
    -Handling overfitting in decision trees
    K-fold cross validation(this video)
    Introductory topics
    -Loss functions
    -Accuracy, generalization
    -Supervised, unsupervised methods
    -Decision boundary etc.
    -Prediction and Interpretation
    -Standardization and Normalization
    Gradient boosting
    not here:
    Mean-Shift
    DBSCAN
    Naive Bayes
    Neural Networks
    Apriori Algorithm
    Feature Selection

  • @abhijeetgopal4978
    @abhijeetgopal4978 4 ปีที่แล้ว +2

    HOW 👏 ARE 👏 YOU 👏 SO 👏 GOOD 👏 AT 👏 EXPLAINING 👏

  • @larry1285
    @larry1285 5 ปีที่แล้ว +2

    thank you sir, your slides are way more understandable than my professor's

  • @xmartazi
    @xmartazi 5 หลายเดือนก่อน +1

    OMG this is the first tiny BAM that I encounter in my whole life, I'm schocked!

    • @statquest
      @statquest  5 หลายเดือนก่อน

      :)

  • @neelusingh2467
    @neelusingh2467 4 ปีที่แล้ว +1

    All the things are crystal clear, you are doing a very good job, you are amazing man....hats off.

    • @statquest
      @statquest  4 ปีที่แล้ว

      Thank you so much 😀

  • @petertavaszi5598
    @petertavaszi5598 3 ปีที่แล้ว +2

    bought 3 of your albums today. I'm a big fan! keep up this awesome channel!!

    • @statquest
      @statquest  3 ปีที่แล้ว

      TRIPLE BAM! Thank you very much! :)

  • @CSSoda
    @CSSoda 5 ปีที่แล้ว +2

    Thank you. BOMBASTIC BAM. It's super easy to comprehend.
    Now I'm gonna share this video like crazy!! BAM BAM BAM

    • @statquest
      @statquest  5 ปีที่แล้ว +1

      Awesome!!! Thank you very much.