The University of Tokyo, RIKEN Center for AIP
Zeke Xie, Issei Sato, Masashi Sugiyama
deep learning dynamics;SGD;diffusion;flat minima;stochastic optimization
A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat Minima