IST Austria & Neural Magic; University of Surrey; IST Austria; ETH Zurich
Giorgi Nadiradze, Amirmojtaba Sabour, Peter Davies, Shigang Li, Dan Alistarh
distributed optimization;quantization;asynchrony;decentralized optimization;non-blocking algorithms
Asynchronous Decentralized SGD with Quantized and Local Updates