Huawei Noah’s Ark Lab; University of Padua; Tsinghua University
Wang Benyou, Yuxin Ren, Lifeng Shang, Xin Jiang, Qun Liu
pre-trained language models;tensor decomposition;compression;BERT
Exploring extreme parameter compression for pre-trained language models