Department of Automation, BNRist, Tsinghua University, Beijing, China; Beijing Academy of Artificial Intelligence, Beijing, China; Department of Automation, BNRist, Tsinghua University, Beijing, China; Beijing Academy of Artificial Intelligence, Beijing, China
Zanlin Ni, Yulin Wang, Jiangwei Yu, Haojun Jiang, Yue Cao, Gao Huang
Deep Incubation: Training Large Models by Divide-and-Conquering