Department of Computer Science, ETH Zürich; Mila and DIRO, Université de Montréal; AMS and MINDS, Johns Hopkins University
Antonio Orvieto, Simon Lacoste-Julien, Nicolas Loizou
Optimization;Convex Optimization;SGD;Gradient Descent;Adaptive Methods;Polyak Stepsize
Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution