Agency for Science, Technology and Research (A*STAR); Osaka University; Meetyou AI Lab, Xiamen Key Laboratory of Women’s Internet Health Management
Large language model;Retrieval augmented;Knowledge compression;Question Answering
TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reduction