Institute of Evaluation and Assessment Research, Academy of Military Science, Beijing, China; Institute of Automation CAS, School of Artificial Intelligence, University of CAS, Beijing, China; Department of Information Engineering, Army Academy of Artillery and Air Defense, Hefei, China
Wei Tao, sheng long, Gaowei Wu, Qing Tao
Deep learning;convex optimization;momentum methods;adaptive heavy-ball methods;optimal convergence
The Role of Momentum Parameters in the Optimal Convergence of Adaptive Polyak's Heavy-ball Methods