cs.CL cs.LG
UNComp: Uncertainty-Aware Long-Context Compressor for Efficient Large Language Model Inference
Jing Xiong Jianghan Shen Fanghua Ye Chaofan Tao Zhongwei Wan Jianqiao Lu Xun Wu Chuanyang Zheng Zhijiang Guo Lingpeng Kong Ngai Wong