UBTECH Sydney AI Centre, School of Computer Science, Faculty of Engineering, The University of Sydney; University of Science and Technology of China; UBTECH Sydney AI Centre, School of Computer Science, Faculty of Engineering, The University of Sydney
neural network;nonlinear activation;loss surface;spurious local minimum
Piecewise linear activations substantially shape the loss surfaces of neural networks