cs.AI cs.LG I.2; I.5
Stripelis, Dimitris Xu, Zhaozhuo Hu, Zijian Shah, Alay Dilipbhai Jin, Han Yao, Yuhang Zhang, Jipeng Zhang, Tong Avestimehr, Salman He, Chaoyang
TensorOpera Router: A Multi-Model Router for Efficient LLM Inference