cs.DC cs.CL cs.LG
P/D-Serve: Serving Disaggregated Large Language Model at Scale
Yibo Jin Tao Wang Huimin Lin Mingyang Song Peiyang Li Yipeng Ma Yicheng Shan Zhengfan Yuan Cailong Li Yajing Sun Tiandeng Wu Xing Chu Ruizhi Huan Li Ma Xiao You Wenting Zhou Yunpeng Ye Wen Liu Xiangkun Xu Yongsheng Zhang Tiantian Dong Jiawei Zhu Zhe Wang Xijian Ju Jianxun Song Haoliang Cheng Xiaojing Li Jiandong Ding Hefei Guo Zhengyong Zhang