The University of Hong Kong; OpenGVLab, Shanghai AI Laboratory; Southern University of Science and Technology
Peng Xu, Wenqi Shao, Mengzhao Chen, Shitao Tang, Kaipeng Zhang, Gao Peng, Fengwei An, Yu Qiao, Ping Luo
Large Language Model Compression;LLM Pruning
BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation