Inria - ENS Paris; EPFL; Microsoft Research
Mathieu Even, Scott Pesme, Suriya Gunasekar, Nicolas Flammarion
SGD;GD;implicit bias;large stepsizes;edge of stability;diagonal linear networks
(S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability