Noah’s Ark Lab, Huawei; Dept. of Comp. Sci. & Tech., Institute Guo Qiang, Tsinghua University, Beijing, China; International Innovation Center of Tsinghua University, Shanghai, China; Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China
Shengding Hu, Zhen Zhang, Ning Ding, Yadao Wang, Yasheng Wang, Zhiyuan Liu, Maosong Sun
Parameter Efficient Tuning;Pre-trained Models;Neural Architecture Search;Delta Tuning
Sparse Structure Search for Delta Tuning