Subsequent to {TAIL ~ the gradient propagation}, {HEAD ~ the weights} can be normalized, thereby preventing convergence to a local optimum 
Subsequent to
Subsequent to { TAIL ~ the gradient propagation } , { HEAD ~ the weights } can be normalized , thereby preventing convergence to a local optimum
REL REL TAIL TAIL TAIL TAIL TAIL TAIL TAIL OTH HEAD HEAD HEAD HEAD HEAD HEAD OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH OTH