College of Computer Science and Technology, Zhejiang University; The University of Sydney; JD Explore Academy, JD.com, Inc. & Artificial Intelligence and its Applications Institute, School of Informatics, University of Edinburgh
Tongtian Zhu, Fengxiang He, Kaixuan Chen, Mingli Song, Dacheng Tao
Decentralized SGD and Average-direction SAM are Asymptotically Equivalent