School of Mathematical Sciences, Peking University, Beijing, 100081, P.R. China; Department of Mathematics, Stanford University, Stanford, CA 94305
Mingze Wang, Chao Ma
non-convex optimization;training dynamics;neural network
Understanding Multi-phase Optimization Dynamics and Rich Nonlinear Behaviors of ReLU Networks