Northeastern University, Boston, MA; MERL, Cambridge, MA
Huan Wang, Suhas Lohit, Michael Jones, Yun Fu
knowledge distillation;data augmentation;CutMix;CutMixPick;covariance of teacher-student cross-entropy;teacher's mean probability
What Makes a "Good" Data Augmentation in Knowledge Distillation - A Statistical Perspective