IST Austria & NeuralMagic; IST Austria; ETH Zurich
Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh
compression;quantization;generative pre-trained transformers;GPT;second-order methods
OPTQ: Accurate Quantization for Generative Pre-trained Transformers