Courant Institute of Mathematical Sciences, New York University, New York, NY 10012, USA
Zihan Wang, Arthur Jacot
implicit bias;SGD;low-rank;linear networks
Implicit bias of SGD in $L_2$-regularized linear DNNs: One-way jumps from high to low rank