Deep Learning Lecture 4.2 - Gradient Descent

Deep Learning Lecture: Optimization Methods
Gradient Descent (GD)
Newton's Method
Choosing the GD step size