The gradient descent algorithm is used all over the machine learning landscape; from optimizing Linear Regression to training some of the most advanced neural network models. The goal of gradient descent is to minimize any function, and it can take any number of parameters.

Defining the Model

Choosing a Learning Rate

Gradient Descent for Linear Regression

Gradient Descent for Multiple Linear Regression

Normal Equation - Alternative to Gradient Descent

Scaling and Engineering Features

Gradient Descent for Logistic Regression