This method of updating adjusts {HEAD ~ the learning rate} allowing {TAIL ~ faster convergence} to the global optimum with a reasonable number of iterations without adding unnecessary tuning parameters 
allowing
This method of updating adjusts { HEAD ~ the learning rate } allowing { TAIL ~ faster convergence } to the global optimum with a reasonable number of iterations without adding unnecessary tuning parameters
OTH OTH OTH OTH OTH HEAD HEAD HEAD HEAD HEAD HEAD HEAD REL TAIL TAIL TAIL TAIL TAIL TAIL OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH