Qualcomm AI Research, Amsterdam, The Netherlands
Yelysei Bondarenko, Markus Nagel, Tijmen Blankevoort
transformers;LLM;softmax;attention;outliers;quantization;post-training quantization
Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing