Princeton Language and Intelligence, Princeton University; Department of Computer Science and Technology, Tsinghua University
Mengzhou Xia, Tianyu Gao, Zhiyuan Zeng, Danqi Chen
pruning;efficiency;large language models;pre-training
Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning