KAUST*; KAUST; KAUST†& TU Munich
Peter Richtarik, Igor Sokolov, Ilyas Fatkhullin
error feedback;distributed learning;communication compression;TopK;contractive compressor;distributed training;distributed optimization
EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback