University of Tokyo, RIKEN Center for Advanced Intelligence Project; University of Toronto, Vector Institute for Artiﬁcial Intelligence; Kyushu Institute of Technology, RIKEN Center for Advanced Intelligence Project
Atsushi Nitanda, Denny Wu, Taiji Suzuki
Neural Network Optimization;Mean field Regime;Overparameterization;Langevin Algorithm
Particle Dual Averaging: Optimization of Mean Field Neural Network with Global Convergence Rate Analysis