During operation as {TAIL ~ the solution} approaches a local minimum, because the error does not approach zero, {HEAD ~ the ratio} of the error gradient to the norm squared of the error gradient will approach infinity causing the weights to jump in magnitude thus moving away from the local minimum 
During operation as { TAIL ~ the solution } approaches a local minimum , because the error does not approach zero , { HEAD ~ the ratio } of the error gradient to the norm squared of the error gradient will approach infinity causing the weights to jump in magnitude thus moving away from the local minimum
OTH OTH OTH TAIL TAIL TAIL TAIL TAIL TAIL OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH HEAD HEAD HEAD HEAD HEAD HEAD OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH