cs.DC cs.SY eess.SY
Kunal Jain Anjaly Parayil Ankur Mallick Esha Choukse Xiaoting Qin Jue Zhang Íñigo Goiri Rujia Wang Chetan Bansal Victor Rühle Anoop Kulkarni Steve Kofsky Saravan Rajmohan
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling