Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, School of Informatics, Xiamen University, 361005, P.R. China. Institute of Artificial Intelligence, Xiamen University. (Corresponding Author: rrji@xmu.edu.cn); ByteDance Inc.; Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, School of Informatics, Xiamen University, 361005, P.R. China.; Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, School of Informatics, Xiamen University, 361005, P.R. China. (This work was done when Yuexiao Ma was intern at ByteDance Inc.); Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, School of Informatics, Xiamen University, 361005, P.R. China. Peng Cheng Laboratory, Shenzhen, China.
Yuexiao Ma, Huixia Li, Xiawu Zheng, Feng Ling, Xuefeng Xiao, Rui Wang, Shilei Wen, Fei Chao, Rongrong Ji
post-training quantization;large language model;Affine Transformation
AffineQuant: Affine Transformation Quantization for Large Language Models