Machine Intelligence Technology Lab, Alibaba DAMO Academy, Hangzhou, China; Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China; School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China
Ping Guo, Xiangpeng Wei, Yue Hu, Baosong Yang, Dayiheng Liu, Fei Huang, jun xie
cross-lingual pretraining;language-agnostic representation
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning