Computer Science Department, University of California, Los Angeles, Los Angeles, CA 90095, USA; Computer Science Department, Johns Hopkins University, Baltimore, MD 21218, USA
Jingfeng Wu, Difan Zou, vladimir braverman, Quanquan Gu
SGD;regularization;implicit bias
Direction Matters: On the Implicit Bias of Stochastic Gradient Descent with Moderate Learning Rate