Shanghai Engineering Research Center of Intelligent Vision and Imaging; Shanghai Engineering Research Center of Energy Efficient and Custom AI IC; ShanghaiTech University; JD Explore Academy; The University of Sydney; Meituan Inc.
Xianing Chen; Qiong Cao; Yujie Zhong; Jing Zhang; Shenghua Gao; Dacheng Tao
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers