Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George Dahl, Chris Shallue, Roger Grosse
Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model