Currently at Google. No work performed at Google.; School of Artificial Intelligence, Jilin University, China; Nanjing University of Information Science and Technology, China; Mohamed bin Zayed University of Artificial Intelligence, UAE
Xiaohan Zhao, Hualin Zhang, Zhouyuan Huo, Bin Gu
asynchronous algorithm;one-device learning;forward gradient descent;directional derivative;forward algorithms
Accelerated On-Device Forward Neural Network Training with Module-Wise Descending Asynchronism