How I think about Logistic Regression - Technical Interlude

แชร์
ฝัง
  • เผยแพร่เมื่อ 3 ส.ค. 2024
  • The Math Behind Logistic Regression.
    Negative Log Likelihood 00:00-05:25
    Gradient Descent Step by Step 05:26-07:20
    Scale Your Data 07:21-09:09
    Part 1: • How I think about Logi...
    Part 2: • How I think about Logi...
    Visualization and animation code on GitHub: github.com/gallettilance/repr...
    Thumbnail by / endless.yarning
    #mathformachinelearning #gradientdescent #machinelearning #datascience #datasciencebasics #datasciencetutorial #machinelearningalgorithm #logisticregression #machinelearningbasics #maths #softmax #multinomial #classification #linearregression #probability #probabilitytheory #education #math #machinelearningtutorialforbeginners #machinelearningtutorial #neuralnetworks
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 12

  • @mie5953
    @mie5953 วันที่ผ่านมา

    Nice video, keep going!
    On the next step, gradients will be small, [-0.12, 0.1, -0.001], so we won't get a large improvement. The weights after the next step will be [0.574, -2.302, 2.927], and NLL here equals 0.0476, which is again smaller than the previous one (0.0486).
    Step: 0, NLL: 0.5707
    W = [1.0000, -2.0000, 3.0000]
    grad = [4.3791, 2.9224, 0.7301]
    Step: 1, NLL: 0.0486
    W = [0.5621, -2.2922, 2.9270]
    grad = [-0.1198, 0.1043, -0.0016]
    Step: 2, NLL: 0.0476
    W = [0.5741, -2.3027, 2.9271]
    grad = [-0.0801, 0.1181, 0.0038]
    ... (a few hundreds of steps later)
    Step:999, NLL: 0.0024
    W = [1.4923, -4.3960, 2.8096]
    grad = [-0.0029, 0.0067, 0.0004]

    • @howithinkabout
      @howithinkabout  วันที่ผ่านมา

      @@mie5953 🙌 incredible work!!

  • @user-mj5nx8yf9b
    @user-mj5nx8yf9b 23 วันที่ผ่านมา

    Another goated video! Keep it up!

  • @stunks6147
    @stunks6147 7 วันที่ผ่านมา

    Excited to see how you explain neural networks! Keep up the good work!

    • @howithinkabout
      @howithinkabout  7 วันที่ผ่านมา

      Thank you! Part 3 will be out next (hopefully in the next week) and right after that will be a neural network series

  • @jakesimonds5051
    @jakesimonds5051 หลายเดือนก่อน +1

    These videos are fantastic. Your pacing is (for me at least) excellent, the illustrations are awesome, and you're doing a fantastic job of job of motivating everything. Keep it up!!!!!

    • @howithinkabout
      @howithinkabout  หลายเดือนก่อน

      So glad to hear it! Thanks for the kind and encouraging words :) I'll do my best!

  • @frannydonington9925
    @frannydonington9925 หลายเดือนก่อน +1

    Another great video!! Such good quality explanations. A really great study tool :)

    • @howithinkabout
      @howithinkabout  หลายเดือนก่อน

      thank you so much!! 🙏

  • @ssingh7317
    @ssingh7317 หลายเดือนก่อน

    Keep this Machine Learning concepts series videos :)

    • @howithinkabout
      @howithinkabout  หลายเดือนก่อน

      I got big plans for this channel :) but let me know what you would like to learn about!

    • @ssingh7317
      @ssingh7317 หลายเดือนก่อน

      @@howithinkabout I would love to watch mathematics for better understanding of algorithms.