Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua-Bosch Joint Center for ML, BNRist Center, State Key Lab for Intell. Tech. & Sys., Tsinghua University, Beijing, China; Pazhou Lab, Guangzhou, 510330, China; Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua-Bosch Joint Center for ML, BNRist Center, State Key Lab for Intell. Tech. & Sys., Tsinghua University, Beijing, China
Guande He, Jianfei Chen, Jun Zhu
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models