Australian Institute for Machine Learning, University of Adelaide; Mathematical Institute for Data Science, Johns Hopkins University
Lachlan MacDonald, Jack Valmadre, Hemanth Saratchandran, Simon Lucey
optimisation;optimization;skip;connection;normalisation;normalization;deep;learning;polyak;lojasiewicz;lipschitz
On skip connections and normalisation layers in deep optimisation