NTT DATA Mathematical Systems Inc., Tokyo, Japan; Graduate School of Information Science and Technology, The University of Tokyo; Graduate School of Information Science and Technology, The University of Tokyo; Center for Advanced Intelligence Project, RIKEN, Tokyo, Japan
Tomoya Murata, Taiji Suzuki
nonconvex optimization;distributed learning;local SGD;escaping saddle points;communication efficiency
Escaping Saddle Points with Bias-Variance Reduced Local Perturbed SGD for Communication Efficient Nonconvex Distributed Learning