Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh
quantization;sparsity;large language models
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression