The Hong Kong University of Science and Technology; Xi’an Jiaotong University
Rui Pan, Haishan Ye, Tong Zhang
optimization;learning rate schedule;optimal convergence rate
Eigencurve: Optimal Learning Rate Schedule for SGD on Quadratic Objectives with Skewed Hessian Spectrums