cs.DC cs.AI cs.LG
FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression
Zhenheng Tang Xueze Kang Yiming Yin Xinglin Pan Yuxin Wang Xin He Qiang Wang Rongfei Zeng Kaiyong Zhao Shaohuai Shi Amelie Chi Zhou Bo Li Bingsheng He Xiaowen Chu