cs.DC cs.AI cs.LG
Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer
Jinghan Yao Sam Ade Jacobs Masahiro Tanaka Olatunji Ruwase Aamir Shafi Hari Subramoni Dhabaleswar K. Panda