Weigao Sun, Qin Zhen, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong
Distributed Training;Data Parallelism;Local Updating;Asynchronous Communication
CO2: Efficient Distributed Training with Full Communication-Computation Overlap