Department of Computer Science, University of California, Los Angeles, Los Angeles, CA 90095
Yiwen Kou, Zixiang Chen, Quanquan Gu
ReLU Neural Networks;Implicit Bias;Deep Learning Theory
Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data