Google; DeepMind
Samuel Smith, Benoit Dherin, David Barrett, Soham De
SGD;learning rate;batch size;optimization;generalization;implicit regularization;backward error analysis;SDE;stochastic differential equation;ODE;ordinary differential equation
On the Origin of Implicit Regularization in Stochastic Gradient Descent