Microsoft Research; University of California, San Diego
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
Understand and Modularize Generator Optimization in ELECTRA-style Pretraining