University of California, Los Angeles; University of California, Santa Barbara; DAMO Academy, Alibaba Group
Bicheng Ying, Kun Yuan, Yiming Chen, Hanbin Hu, PAN PAN, Wotao Yin
Decentralized optimization;distributed and parallel algorithms;stochastic optimization;deep learning
Exponential Graph is Provably Efficient for Decentralized Deep Training