Electrical and Computer Engineering Department, University of Pittsburgh, PA, USA; JD Finance America Corporation, Mountain View, CA, USA; Electrical and Computer Engineering Department, University of Pittsburgh, PA, USA
An Xu, Zhouyuan Huo, Heng Huang
On the Acceleration of Deep Learning Model Parallelism With Staleness