cs.CL
More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression
Jiebin Zhang Dawei Zhu Yifan Song Wenhao Wu Chuqiao Kuang Xiaoguang Li Lifeng Shang Qun Liu Sujian Li