Huawei Noah’s Ark Lab, Beijing, China; State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China
Xin-Chun Li, Wen-shu Fan, Shaoming Song, Yinchuan Li, bingshuai Li, Shao Yunfeng, De-Chuan Zhan
knowldege distillation;larger teacher;temperature scaling
Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again