University of Guelph, Vector Institute; University of Toronto, Vector Institute
Mufan Li, Mihai Nica, Dan Roy
ResNet;infinite-depth-and-width;log-Gaussian;hypoactivation;balanced ResNet
The future is log-Gaussian: ResNets and their infinite-depth-and-width limit at initialization