Harvard University & Mobileye; University of California San Diego; Hebrew University & Mobileye
Gal Kaplun, Eran Malach, Preetum Nakkiran, Shai Shalev-Shwartz
Knowledge Distillation;Teacher-Student;Learning Theory;Learning to Sample;Ensembling
Knowledge Distillation: Bad Models Can Be Good Role Models