School of information and Electronics, Beijing Institute of Technology; Huawei Noah’s Ark Lab; Key Laboratory of Machine Perception (MOE), School of Intelligence Science and Technology, Peking University
Zhiwei Hao, Jianyuan Guo, Ding Jia, Kai Han, Yehui Tang, Chao Zhang, Han Hu, Yunhe Wang
vision transformer;knowledge diatillation;manifold learning
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation