Microsoft
Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He
Post-Training Quantization;Layer-by-Layer Knowledge Distillation;BERT;GPT-3;GPT-Neox-20B
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers