Microsoft Research Asia, Shanghai, China; China and Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University; Department of Electrical Engineering and Computer Science, University of Michigan; Department of Computer Science, University of Colorado Boulder; School of Microelectronics, Fudan University; School of Mathematics Statistics, University of Glasgow; Department of Engineering Science, University of Oxford
Yubin Shi, Yixuan Chen, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang, Robert Dick, Qin Lv, Yingying Zhao, Fan Yang, Tun Lu, Ning Gu, Li Shang
Modular Adaptive Training;Efficient Training;Over-parameterized Model;Neural Tangent Kernel.
Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models