Huawei Inc.; Shanghai Jiao Tong University
Bowen Shi, XIAOPENG ZHANG, Yaoming Wang, Li Jin, Wenrui Dai, Junni Zou, Hongkai Xiong, Qi Tian
contrastive learning;mask image moding;feature distillation
Hybrid Distillation: Connecting Masked Autoencoders with Contrastive Learners