Carnegie Mellon University, Mohamed bin Zayed University of Artificial Intelligence, Petuum Inc.; Carnegie Mellon University; Massachusetts Institute of Technology; Columbia University
Han Guo, Philip Greengard, Eric Xing, Yoon Kim
Low-rank plus Quantized Matrix Decomposition;Efficient Language Model Finetuning
LQ-LoRA: Low-rank plus Quantized Matrix Decomposition for Efficient Language Model Finetuning