University of Illinois Urbana-Champaign; Meituan, Beijing, China; Department of Computer Science and Technology, Tsinghua University, Beijing, China; Zhejiang University, Hangzhou, China; School of Software, Tsinghua University, Beijing, China
Biru Zhu, Yujia Qin, Ganqu Cui, Yangyi Chen, Weilin Zhao, Chong Fu, Yangdong Deng, Zhiyuan Liu, Jingang Wang, Wei Wu, Maosong Sun, Ming Gu
Backdoor Defense;Pre-trained Language Models
Moderate-fitting as a Natural Backdoor Defender for Pre-trained Language Models