Department of Computer Science, Princeton University
Sadhika Malladi, Kaifeng Lyu, Abhishek Panigrahi, Sanjeev Arora
stochastic differential equations;Adam;RMSprop;scaling rule
On the SDEs and Scaling Rules for Adaptive Gradient Algorithms