XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference
Monteiro, Joao Marcotte, {\'E}tienne Noel, Pierre-Andre Zantedeschi, Valentina Vazquez, David Chapados, Nicolas Pal, Christopher Taslakian, Perouz