Institute for Interdisciplinary Information Sciences, Tsinghua University; Department of Computer Science, Princeton University
Xinran Gu, Kaifeng Lyu, Longbo Huang, Sanjeev Arora
local SGD;SDE;regularization;implicit bias;deep learning theory;optimization;distributed training
Why (and When) does Local SGD Generalize Better than SGD?