Intermediate Layer Distillation with the Reused Teacher Classifier: A Study on the Importance of the Classifier of Attention-based Models
Zhang, Hang Mozafari, Seyyed Hasan Clark, James J. Meyer, Brett H. Gross, Warren J.