University of Pennsylvania; DAMO Academy, Alibaba Group
Kun Yuan; Yiming Chen; Xinmeng Huang; Yingya Zhang; Pan Pan; Yinghui Xu; Wotao Yin
DecentLaM: Decentralized Momentum SGD for Large-Batch Deep Training