Institute of Computer Science, Johannes-Gutenberg University Mainz, Staudingerweg 9, 55122 Mainz, Germany; Institute of Computer Science, Johannes Gutenberg-University of Mainz, Staudingerweg 9, 55128 Mainz, Germany
Christian Ali Mehmeti-Göpel, David Hartmann, Michael Wand
deep learning theory;loss landscape;harmonic distortion analysis;network trainability
Ringing ReLUs: Harmonic Distortion Analysis of Nonlinear Feedforward Networks