School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University, Shenzhen, China; Peng Cheng Laboratory, Shenzhen, China
Hanyang Peng, Shuang Qin, Yue Yu, Jin Wang, Hui Wang, Ge Li
optimizer;1-bit optimizer;distributed learning;optimization for deep networks;communication efficiency
Birder: Communication-Efficient 1-bit Adaptive Optimizer for Practical Distributed DNN Training