Department of Automation, Tsinghua University, China
Chaofei Wang, Qisen Yang, Rui Huang, Shiji Song, Gao Huang
Deep learning;image classification;intermediate model;knowledge distillation;mutual information.
Efficient Knowledge Distillation from Model Checkpoints