Department of Statistics and Data Science, University of Pennsylvania; School of Mathematical Sciences, Peking University
Lei Wu, Mingze Wang, Weijie Su
Flat minima;stochastic gradient descent;linear stability;implicit regularization;neural network
The alignment property of SGD noise and how it helps select flat minima: A stability analysis