ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency
Yao, Yuhang Jin, Han Shah, Alay Dilipbhai Han, Shanshan Hu, Zijian Stripelis, Dimitris Ran, Yide Xu, Zhaozhuo Avestimehr, Salman He, Chaoyang