Gradient Descent

Assume that the bottom of the valley is the destination, by using x as independent parameter, the faster route going down the cliff will be the modal.

1. Batch Gradient Descent
2. Stochastic Gradient Descent
3. Mini Batch gradient descent

Matching pursuit