cs.CL cs.AI cs.LG
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection
Wei Wu Zhuoshi Pan Chao Wang Liyi Chen Yunchu Bai Kun Fu Zheng Wang Hui Xiong