Jung Hwan Heo, Jeonghoon Kim, Beomseok Kwon, Byeongwook Kim, Se Jung Kwon, Dongsoo Lee
large language models;quantization;model compression
Rethinking Channel Dimensions to Isolate Outliers for Low-bit Weight Quantization of Large Language Models