SGD;learning rate;step size schedules;stochastic approximation;stochastic optimization;deep learning;non-convex optimization;stochastic gradient descent
Rethinking learning rate schedules for stochastic optimization