Gradient Descent

Assume that the bottom of the valley is the destination, by using x as independent parameter, the faster route going down the cliff will be the modal.

  1. Batch Gradient Descent
  2. Stochastic Gradient Descent
  3. Mini Batch gradient descent

Matching pursuit