School of Mathematical Sciences, Institute of Natural Sciences, MOE-LSC and Qing Yuan Research Institute, Shanghai Jiao Tong University; Shanghai Center for Brain Science and Brain-Inspired Technology; School of Mathematical Sciences, Institute of Natural Sciences, MOE-LSC and Qing Yuan Research Institute, Shanghai Jiao Tong University; School of Mathematical Sciences, Institute of Natural Sciences, MOE-LSC and Qing Yuan Research Institute, Shanghai Jiao Tong University; CMA-Shanghai, Shanghai Artificial Intelligence Laboratory
Hanxu Zhou, Zhou Qixuan, Zhenyuan Jin, Tao Luo, Yaoyu Zhang, Zhi-Qin Xu
training dynamics;neural networks;phase diagram;initialization
Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width