The Chinese University of Hong Kong, Shenzhen; Alibaba DAMO Academy; Princeton University; Fudan University
Zhuoqing Song, Weijian Li, Kexin Jin, Lei Shi, Ming Yan, Wotao Yin, Kun Yuan
Decentralized optimization;network topologies;maximum degree;consensus rate;communication-efficient
Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate