University of California, Los Angeles & SenseTime Research; SenseTime Research; National Laboratory of Pattern Recognition, Institute of Automation, CAS; National Laboratory of Pattern Recognition, Institute of Automation, CAS & School of Artificial Intelligence, University of Chinese Academy of Sciences
Zhaowen Li, Zhiyang Chen, Fan Yang, Wei Li, Yousong Zhu, Chaoyang Zhao, Rui Deng, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang
Self-supervised;Transformer;Attention-guided mask strategy
MST: Masked Self-Supervised Transformer for Visual Representation