OpenGVLab, Shanghai AI Laboratory, The University of Hong Kong; OpenGVLab, Shanghai AI Laboratory; The University of Hong Kong; The Chinese University of Hong Kong
Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, Peng Xu, Lirui Zhao, Zhiqian Li, Kaipeng Zhang, Gao Peng, Yu Qiao, Ping Luo
Large Language Model Compression;Differentiable Quantization
OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models