learning dynamics;loss landscape;stochastic differential equation;modified equation analysis;hessian;geometry;physics;fokker-plank;modified loss;probability currents;diffusion
Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion