University of Illinois at Urbana-Champaign, IL, USA; University of Minnesota - Twin Cities, MN, USA; Shenzhen Research Institute of Big Data, The Chinese University of Hong Kong, Shenzhen, China
Jiawei Zhang, Yushun Zhang, Mingyi Hong, Ruoyu Sun, Zhi-Quan Luo
deep learning theory;narrow;small neural networks;optimization;memorization;deep learning;neural networks
When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work