Hong Kong University of Science and Technology, Tencent Youtu Lab; East China Normal University; Zhejiang University; University of California, Santa Cruz; Tencent Youtu Lab
Yuting Gao, Jia-Xin Zhuang, Shaohui Lin, Hao Cheng, Xing Sun, Ke Li, Chunhua Shen
DisCo: Remedying Self-Supervised Learning on Lightweight Models with Distilled Contrastive Learning