Department of Mathematics and Statistics, McGill University, Montreal, QC H3A 0B9
Kiwon Lee, Andrew Cheng, Elliot Paquette, Courtney Paquette
Stochastic Gradient Descent with Momentum;Random Matrix Theory;High Dimensional Probability
Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions