Technion - Israel Institute of Technology; Habana-Labs
Niv Giladi, Shahar Gottlieb, moran shkolnik, Asaf Karnieli, Ron Banner, Elad Hoffer, Kfir Y. Levy, Daniel Soudry
distributed optimization;large-scale parallel SGD;synchronous training
DropCompute: simple and more robust distributed synchronous training via compute variance reduction