Dept. of Comp. Sci. and Tech., Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint ML Center, Tsinghua University; Institute for Interdisciplinary Information Sciences, Tsinghua University
Haocheng Xi, ChangHao Li, Jianfei Chen, Jun Zhu
neural network quantization;transformer;matrix multiplication;randomized numerical linear algebra
Training Transformers with 4-bit Integers