Megvii Technology; University of Edinburgh
Ruosi Wan, Zhanxing Zhu, Xiangyu Zhang, Jian Sun
normalization;weight decay;stochastic gradient descent;momentum;neural network
Spherical Motion Dynamics: Learning Dynamics of Normalized Neural Network using SGD and Weight Decay