Shanghai Jiao Tong University
Zhiming Zhou, Qingru Zhang, Guansong Lu, Hongwei Wang, Weinan Zhang, Yong Yu
optimizer;Adam;convergence;decorrelation
AdaShift: Decorrelation and Convergence of Adaptive Learning Rate Methods