Graduate School of Information Science and Technology, The University of Tokyo; Center for Advanced Intelligence Project, RIKEN; PRESTO, Japan Science and Technology Agency; Graduate School of Information Science and Technology, The University of Tokyo; Center for Advanced Intelligence Project, RIKEN
Atsushi Nitanda, Taiji Suzuki
stochastic gradient descent;two-layer neural network;over-parameterization;neural tangent kernel
Optimal Rates for Averaged Stochastic Gradient Descent under Neural Tangent Kernel Regime