Gaoling School of Artificial Intelligence, Renmin University of China, Beijing; NLP Group, DCST, IAI, BNRIST, Tsinghua University, Beijing; Pattern Recognition Center, WeChat AI, Tencent Inc.
pre-trained language model;parameter sharing;inference acceleration
Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models