School of information and Electronics, Beijing Institute of Technology; Huawei Noah’s Ark Lab; School of Computer Science, Faculty of Engineering, The University of Sydney
Zhiwei Hao, Jianyuan Guo, Kai Han, Yehui Tang, Han Hu, Yunhe Wang, Chang Xu
knowledge distillation;feature distillation;heterogeneous architectures
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation