Department of Computer Science, University of Illinois at Chicago; KDDI Research; Wangxuan Institute of Computer Technology, Peking University
Zixuan Ke, Yijia Shao, Haowei Lin, Tatsuya Konishi, Gyuhak Kim, Bing Liu
Continual learning;Domain-adaptive Pretraining;Post-training
Continual Pre-training of Language Models