A plot showing gradient descent using arrows; the arrow size gets progressively smaller as the algorithm begins to converge. In this case, it is converging on two parameters for linear regression, attempting to minimize the cost function, J(θ0,θ1){\displaystyle J(\theta _{0},\theta _{1})}. The colour of the arrows has no significance; they simply alternate for visibility.
Own work
Eviatar Bach