mmd matching loss student / teacher feature maps input image before matching after matching softmax classification loss fc layer .
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer