Alibaba Group; BNRist, THUIBCS, KLISS, BLBCI, School of Software, Tsinghua University
Yutong Feng, Jianwen Jiang, Mingqian Tang, Rong Jin, Yue Gao
Pre-Training;Contrastive Learning;Representation Learning;Downstream Transferring
Rethinking Supervised Pre-Training for Better Downstream Transferring