cs.LG cs.DC
Mnemosyne: Parallelization Strategies for Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations
Amey Agrawal Junda Chen Íñigo Goiri Ramachandran Ramjee Chaojie Zhang Alexey Tumanov Esha Choukse