This is an automated message from the [Librarian Bot](https://huggingface.co/librarian-bots). I found the following papers similar to this paper. 

The following papers were recommended by the Semantic Scholar API 

* [Prompt Cache: Modular Attention Reuse for Low-Latency Inference](https://huggingface.co/papers/2311.04934) (2023)
* [Stateful Large Language Model Serving with Pensieve](https://huggingface.co/papers/2312.05516) (2023)
* [SparQ Attention: Bandwidth-Efficient LLM Inference](https://huggingface.co/papers/2312.04985) (2023)
* [ESPN: Memory-Efficient Multi-Vector Information Retrieval](https://huggingface.co/papers/2312.05417) (2023)
* [Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge](https://huggingface.co/papers/2312.05693) (2023)

 Please give a thumbs up to this comment if you found it helpful!

 If you want recommendations for any Paper on Hugging Face checkout [this](https://huggingface.co/spaces/librarian-bots/recommend_similar_papers) Space