MIT/LIDS-FODSI; ETH Zurich; INRIA-ENS-PSL Paris
Amir Joudaki, Hadi Daneshmand, Francis Bach
dynamical isometry;Lyapunov analysis;random neural networks
On the impact of activation and normalization in obtaining isometric embeddings at initialization