Meta AI, Menlo Park, CA 94025; Condensed Matter Theory Center & Department of Physics, University of Maryland, College Park, MD 20740
Darshil Doshi, Tianyu He, Andrey Gromov
Criticality;Gaussian Process;Jacobian;LayerNorm;Residual connections;ResNet
Critical Initialization of Wide and Deep Neural Networks using Partial Jacobians: General Theory and Applications