McGill University, Mila - Quebec AI Institute; McGill University; Concordia University; City University of Hong Kong; Western University
Chengming Hu, Haolun Wu, Xuan Li, Chen Ma, Xi Chen, Boyu Wang, Jun Yan, Xue Liu
Knowledge Distillation;Bilevel Optimization;Re-weighting
Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation