Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learning
Communication Efficient Distributed Machine Learning with the Parameter Server