UMass Amherst; Peking University; CMU; CMU & HKUST; HKUST
Zhiqiang Shen, Zhiqiang Shen, Dejia Xu, Zitian Chen, Kwang-Ting Cheng, Marios Savvides
label smoothing;knowledge distillation;image classification;neural machine translation;binary neural networks
Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study