Monday, 11 November 2013

machine learning--02 : Estimate the batch gradient descent is converge or not

This is an exercise from the open course of machine learning, one of the purpose of this exercise is measure the batch gradient descent is converge or not.

Equation 1 is the cost function, the procedures of measuring the convergence of gradient is compare different learning rate of the gradient descent, draw the graph and make sure the value of the cost function is decrease on every iteration.