Department of Physics, Renmin University of China; Gaoling School of Artificial Intelligence, Renmin University of China
parameter-efficient;pre-trained language models;scalability
Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing