Department of Computer Science, University of Surrey, UK; Department of Computer Science, The University of Manchester, UK
Large Language Model;Input Compression
Compressing Context to Enhance Inference Efficiency of Large Language Models