Department of Computer Science and Technology, Tsinghua University; Department of Statistics, The University of Chicago; Department of Electronic Engineering, Tsinghua University; BNRIST, IAI, Tsinghua University
Parameter-efficient;Sparse Adaptation
Sparse Low-rank Adaptation of Pre-trained Language Models