Facebook AI Research; School of Informatics, University of Edinburgh; Ruhr University Bochum; Jagiellonian University; Mila / University of Montreal
Stanislaw Jastrzebski, Zachary Kenton, Nicolas Ballas, Asja Fischer, Yoshua Bengio, Amos Storkey
optimization;generalization;theory of deep learning;SGD;hessian
On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length