Machine Intelligence Technology Lab, Alibaba Group, Hangzhou, China; Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China; School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China
Xiangpeng Wei, Rongxiang Weng, Yue Hu, Luxi Xing, Heng Yu, Weihua Luo
universal representation learning;cross-lingual pretraining;hierarchical contrastive learning
On Learning Universal Representations Across Languages