College of Information Science and Electronic Engineering, Zhejiang University; Department of Computer Science, University of Southern California; Center for Data Science, Beijing Institute of Big Data Research, Peking University; MOE Key Lab of Computational Linguistics, School of EECS, Peking University
Liangchen Luo, Yuanhao Xiong, Yan Liu, Xu Sun
Optimization;SGD;Adam;Generalization
Adaptive Gradient Methods with Dynamic Bound of Learning Rate