Department of Computer Science, ETH Zurich, Switzerland
Junchi YANG, Xiang Li, Ilyas Fatkhullin, Niao He
Nonconvex optimization;Stochastic Gradient Descent;Adaptive methods
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods