Huawei Inc.
Yuhui Xu, Lingxi Xie, Xiaotao Gu, Xin Chen, Heng Chang, Hengheng Zhang, Zhengsu Chen, XIAOPENG ZHANG, Qi Tian
Large Language Models;Quantization;LoRA;Instruct Fine-tuning
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models