cs.DC cs.SY eess.SY
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
Kunal Jain Anjaly Parayil Ankur Mallick Esha Choukse Xiaoting Qin Jue Zhang Íñigo Goiri Rujia Wang Chetan Bansal Victor Rühle Anoop Kulkarni Steve Kofsky Saravan Rajmohan