RWTH Aachen University, Aachen; University of British Columbia, Canada CIFAR AI Chair (Amii)
Leonardo Galli, Holger Rauhut, Mark Schmidt
line search;nonmonotone;stochastic gradient descent;over-parametrized models;Polyak step size;optimization
Don't be so Monotone: Relaxing Stochastic Line Search in Over-Parameterized Models