Princeton University; Yale University; Toyota Technological Institute at Chicago
Runzhe Wang, Sadhika Malladi, Tianhao Wang, Kaifeng Lyu, Zhiyuan Li
momentum;SGD;dynamics
The Marginal Value of Momentum for Small Learning Rate SGD