Pengcheng Laboratory, Shenzhen, China; Huawei Noah’s Ark Lab, Shenzhen, Guangdong, China; Harbin Institute of Technology Shenzhen, Shenzhen, Guangdong, China; Peking University, Beijing, China
Yu Pan, Ye Yuan, Yichun Yin, Zenglin Xu, Lifeng Shang, Xin Jiang, Qun Liu
Model Growth;Efficient Training;Pretrained Model;Multi-linearity
Reusing Pretrained Models by Multi-linear Operators for Efficient Training