Carnegie Mellon University; University of California, Berkeley
deep learning;MLP;ResNet;residual network;exploding gradient problem;vanishing gradient problem;effective depth;batch normalization;covariate shift
Gradients explode - Deep Networks are shallow - ResNet explained