Facebook AI Research; University of Washington; Hugging Face
Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer
quantization;8-bit;transformers;inference
GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale