Department of Electrical Engineering, Technion - Israel Institute of Technology, Haifa, Israel; Department of Computer Science, Technion - Israel Institute of Technology, Haifa, Israel
distributed;asynchronous;large scale;gradient staleness;staleness penalization;sgd;deep learning;neural networks;optimization
Gap-Aware Mitigation of Gradient Staleness