How I think about Logistic Regression - Technical Interlude
ฝัง
- เผยแพร่เมื่อ 3 ส.ค. 2024
- The Math Behind Logistic Regression.
Negative Log Likelihood 00:00-05:25
Gradient Descent Step by Step 05:26-07:20
Scale Your Data 07:21-09:09
Part 1: • How I think about Logi...
Part 2: • How I think about Logi...
Visualization and animation code on GitHub: github.com/gallettilance/repr...
Thumbnail by / endless.yarning
#mathformachinelearning #gradientdescent #machinelearning #datascience #datasciencebasics #datasciencetutorial #machinelearningalgorithm #logisticregression #machinelearningbasics #maths #softmax #multinomial #classification #linearregression #probability #probabilitytheory #education #math #machinelearningtutorialforbeginners #machinelearningtutorial #neuralnetworks - วิทยาศาสตร์และเทคโนโลยี
Nice video, keep going!
On the next step, gradients will be small, [-0.12, 0.1, -0.001], so we won't get a large improvement. The weights after the next step will be [0.574, -2.302, 2.927], and NLL here equals 0.0476, which is again smaller than the previous one (0.0486).
Step: 0, NLL: 0.5707
W = [1.0000, -2.0000, 3.0000]
grad = [4.3791, 2.9224, 0.7301]
Step: 1, NLL: 0.0486
W = [0.5621, -2.2922, 2.9270]
grad = [-0.1198, 0.1043, -0.0016]
Step: 2, NLL: 0.0476
W = [0.5741, -2.3027, 2.9271]
grad = [-0.0801, 0.1181, 0.0038]
... (a few hundreds of steps later)
Step:999, NLL: 0.0024
W = [1.4923, -4.3960, 2.8096]
grad = [-0.0029, 0.0067, 0.0004]
@@mie5953 🙌 incredible work!!
Another goated video! Keep it up!
Excited to see how you explain neural networks! Keep up the good work!
Thank you! Part 3 will be out next (hopefully in the next week) and right after that will be a neural network series
These videos are fantastic. Your pacing is (for me at least) excellent, the illustrations are awesome, and you're doing a fantastic job of job of motivating everything. Keep it up!!!!!
So glad to hear it! Thanks for the kind and encouraging words :) I'll do my best!
Another great video!! Such good quality explanations. A really great study tool :)
thank you so much!! 🙏
Keep this Machine Learning concepts series videos :)
I got big plans for this channel :) but let me know what you would like to learn about!
@@howithinkabout I would love to watch mathematics for better understanding of algorithms.