SenseTime Research; Yale University; State Key Lab of Software Development Environment, Beihang University
quantization;large language models;outlier
Outlier Suppression+: Accurate quantization of large language models by equivalent and effective shifting and scaling