cs.LG cs.CL cs.DC cs.PF
EPIC: Efficient Position-Independent Context Caching for Serving Large Language Models
Junhao Hu Wenrui Huang Haoyi Wang Weidong Wang Tiancheng Hu Qin Zhang Hao Feng Xusheng Chen Yizhou Shan Tao Xie