Nanjing University; Shanghai Aritifcal Intelligence Laboratory; Tsinghua University
Zhiyu Zhao, Bingkun Huang, Sen Xing, Gangshan Wu, Yu Qiao, Limin Wang
Asymmetric Masked Distillation for Pre-Training Small Foundation Models