Elmore Family School of Electrical and Computer Engineering, Purdue University, IN, USA; Department of Electrical Engineering, University of Notre Dame, IN, USA; College of Information Engineering, Shenyang University of Chemical Technology, Shenyang, China; The Chinese University of Hong Kong, Shenzhen, China; Institute of Automation, Chinese Academy of Sciences, Beijing, China
ruinan Jin, Xingkang He, Lang Chen, Difei Cheng, Vijay Gupta
stochastic gradient descent;momentum;convergence
Revisit last-iterate convergence of mSGD under milder requirement on step size