Skoltech, Yandex Research; Skoltech; Technology Innovation Institute, CMAP, Ecole Polytechnique
Maksim Velikanov, Denis Kuznedelev, Dmitry Yarotsky
SGD;linear models;optimization;analytic framework;NTK
A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta.