Department of Computer Science & Institute of Data Science, The University of Hong Kong; Department of Computer Science, University of California, Los Angeles; Machine Learning Department, Carnegie Mellon University; Department of Statistics & Actuarial Science, The University of Hong Kong
Difan Zou, Yuan Cao, Yuanzhi Li, Quanquan Gu
generalization;gradient descent;Neural tangent kernel;Adam;nonconvex optimization
Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization