Cornell University
Jerry Chee, Yaohui Cai, Volodymyr Kuleshov, Christopher De Sa
Quantization;Large Language Models;Adaptive Rounding;Theoretical Guarantees
QuIP: 2-Bit Quantization of Large Language Models With Guarantees