Georgia Institute of Technology, Atlanta, USA; Microsoft Azure AI, Bellevue, USA
Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation