AI Initiative, KAUST∗, Saudi Arabia; AI Initiative, KAUST, Saudi Arabia
Peter Richtarik, Elnur Gasanov, Konstantin Burlachenko
error feedback;greedy sparsification;distributed optimization;communication complexity;machine cloning;weighted error feedback;quadratic mean;arithmetic mean;large stepsizes
Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants