Georgia Institute of Technology; Microsoft Azure
Yixiao Li, Yifan Yu, Chen Liang, Nikos Karampatziakis, Pengcheng He, Weizhu Chen, Tuo Zhao
quantization;compression;large language models;NLP;machine learning;low rank
LoftQ: LoRA-Fine-Tuning-aware Quantization for Large Language Models