University of Illinois Urbana-Champaign; The Hong Kong University of Science and Technology; Fudan University
Rui Pan, Yuxing Liu, Xiaoyu Wang, Tong Zhang
optimization theory;convergence analysis;heavy-ball momentum;learning rate schedule;near-optimal convergence rate
Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise