I'm currently self studying machine learning, and the very first thing I did after learning about decision boundaries was check if 3blue1brown had a video on it, because his animations are just incredible for understanding math and gaining intuition. The way this video is constructed, and again, the animations used in here are incredible. Thank you so much for making this!
This video is exactly what I was looking for, I was getting confused between decision boundry and the sigmoid function for a 2d input problem, thanks a lot for the wonderful animations!
This is insanely helpful. I feel like I can actually use logistic regression libraries and have a good idea of what's happening. Generalizing this to higher dimensions was eye-opening--I never quite knew what was going on there.
Thanks for the kind words. I thought this video didn't receive the attention I thought it should have. But glad there are others out there like you who find value here. :)
Thanks a ton! I had some life changing events take place in the last few months (graduated, travel, moved, new job). Now that things have settled a bit, I can be more regular :) Thanks for the support. Means a lot!
Why decision boundary doesn't depend on activation function? So if i want to have a curved dicision boundary, i don't have to change activation function, but rather change my features?
Please explain how the value for bias and weigh are calculated That sigma there If n is also 1 Then y1 and x1 What are there values Please I want to calculate and loop them like you did
Super glad you do! Had some life changing events come in the last few months (graduation, move, new job). But now that things have settled, I'll be more frequent. :)
Love your stuff. I'm not a math major, and I've learned that you don't have to be to understand, but it's kind of offputting when people use a ton of symbols. It's not necessary to explain what is going on
Great video. It really helped me to get a better understanding of logistic regression. However, I have a couple of queries - What is the target function of logistic regression which s being learned (like in linear regression we have y = w.T*x)? To what curve do we fit the training data, the decision boundary of sigmoid function (like in linear regression we fit the straight line defined above)? Thank you !!!!
why do we need to use e^-x instead of any f(x) >=0 with every x to express the possibility, I forgot all the math learned from highschool so At This Point I'm Too Afraid to Ask
Thanks so much for watching! I’ll keep your suggestion in mind and see if there is leeway to do this at some point (tho I don’t think it will be anytime soon admittedly).
You've done an amazing video! At 14.40 you show a plot in 3 dimensions. On the z-axis (vertical one) the values should spread on the interval [0,1] which is not clear here. It's not clear why the boundary is not a plane since we have a scatter plot in 3 dimensions. I'm quite confused with the dimensions of the plot.
@@balajikannan7393 There are thousands of function that can map real number to a number between 0 and 1. For example Step function being one of them. Then , why pick sigmoid out of hat ?
This visualization is so strong, I feel like it's like one of those lecture in university that were so good, you'll never forget them!
Thank you for the amazing compliments! I definitely tried a lot with this one haha
I'm currently self studying machine learning, and the very first thing I did after learning about decision boundaries was check if 3blue1brown had a video on it, because his animations are just incredible for understanding math and gaining intuition. The way this video is constructed, and again, the animations used in here are incredible. Thank you so much for making this!
Glad you liked the visuals here. Honestly creating this video solidified my understanding of this as well :)
This video is exactly what I was looking for, I was getting confused between decision boundry and the sigmoid function for a 2d input problem, thanks a lot for the wonderful animations!
This is insanely helpful. I feel like I can actually use logistic regression libraries and have a good idea of what's happening. Generalizing this to higher dimensions was eye-opening--I never quite knew what was going on there.
Thank you mate, I think visualization is so underestimated in universities, in math and science THIS is the key of teaching. Great job!
Thanks for the kind words. I thought this video didn't receive the attention I thought it should have. But glad there are others out there like you who find value here. :)
That was so fire! Nice bro!
A brilliant visualization of the logistic regression, thanks for making this!
My pleasure :)
dude please be regular You will earn more subscribers as you desrve million of subscribers keep it up
Thanks a ton! I had some life changing events take place in the last few months (graduated, travel, moved, new job). Now that things have settled a bit, I can be more regular :) Thanks for the support. Means a lot!
Oh wow! This is so great! I just learned the math in a class but this really explains the intuition! Thank you so much
Of course :) Thanks for watching
simply lovely mate! this helped me connect everything
This video deserves a million views
DUDE YOU ARE A LIFE SAVER. Subbed and reccommended to my fellow msc colleagues. Keep up the great work brother.
Thanks a ton for the share :) And so happy this helps
This was very cool! Thank you!
Why decision boundary doesn't depend on activation function? So if i want to have a curved dicision boundary, i don't have to change activation function, but rather change my features?
Beautifully explained
This is amazing!! Thanks a lot for sharing
Thanks for the video. It is really helpful
Please, how can one optimize the coefficients of a Logistic Regression Model using a Genetic Algorithm?
Excellent explanation of Logistic Regression
17:32 ¿"m" dimensions or "d" dimensions?
Great video, your content is really high quality
Yup. I didn't write m because I didn't want to confound this with the "m" in number of iterations.
Please explain how the value for bias and weigh are calculated
That sigma there
If n is also 1
Then y1 and x1
What are there values
Please I want to calculate and loop them like you did
not seeing a link to visualization program
I really love this channel 😘
Pls post many videos often, not once in blue moon 😁
Super glad you do! Had some life changing events come in the last few months (graduation, move, new job). But now that things have settled, I'll be more frequent. :)
The visualization at the end is what wee need more off
Glad you like the visuals!
Thank you! Super helpful on a lot of levels :)
Love your stuff. I'm not a math major, and I've learned that you don't have to be to understand, but it's kind of offputting when people use a ton of symbols. It's not necessary to explain what is going on
Great video. It really helped me to get a better understanding of logistic regression. However, I have a couple of queries -
What is the target function of logistic regression which s being learned (like in linear regression we have y = w.T*x)?
To what curve do we fit the training data, the decision boundary of sigmoid function (like in linear regression we fit the straight line defined above)?
Thank you !!!!
what is the book in the beginning of the video?
That wasn’t a book; just me listing out some topics :)
These visualizations are hot!
Love both of your channels :)
which is the other channel?
@@kpratik41 3blue1brown
Thank you so much for this video!
You are very welcome. Thank you for watching
why do we need to use e^-x instead of any f(x) >=0 with every x to express the possibility, I forgot all the math learned from highschool so At This Point I'm Too Afraid to Ask
Can u make a video which explains the plot for 3 labels using 2 features, I am just curious how the sigmoid function looks for it.
Amazing work!!!
Thanks so much for watching! I’ll keep your suggestion in mind and see if there is leeway to do this at some point (tho I don’t think it will be anytime soon admittedly).
You've done an amazing video! At 14.40 you show a plot in 3 dimensions. On the z-axis (vertical one) the values should spread on the interval [0,1] which is not clear here. It's not clear why the boundary is not a plane since we have a scatter plot in 3 dimensions. I'm quite confused with the dimensions of the plot.
This video was great, thank you
awesome explanation
thanks so much
You are so welcome
loved the explanation.
But, why do we use sigmoid function ?
A sigmoid function transforms any real number to be between 0 and 1. In other words probability would lie between 0 and 1.
@@balajikannan7393
There are thousands of function that can map real number to a number between 0 and 1. For example Step function being one of them.
Then , why pick sigmoid out of hat ?
@@vijayendrasdm sigmoid function is differentiable which allows us to train our weights using gradient descent, step function is not differentiable
Oh boy, this visualization is incredible. I always knew there was a sigmoid function in 2D. Guess what... It was hidden in 3D LOL
The mystery has been solved by Detective Emporium.
Great!! Thank you
thank you so much
9:03
Sir it's amzing make more on ml
Bro, please use dark theme
I do now. Recent videos