Stanford University; Google; MIT; TU Munich & MIT
Khashayar Gatmiry, Zhiyuan Li, Tengyu Ma, Sashank Reddi, Stefanie Jegelka, Ching-Yao Chuang
Sharpness minimization;Deep learning;Matrix factorization;Deep linear networks;Implicit bias;SGD;Trace of Hessian regularizer
What is the Inductive Bias of Flatness Regularization? A Study of Deep Matrix Factorization Models