Department of Computer Science, Stanford University; Microsoft Research, New England
Tri Dao, Govinda Kamath, Vasilis Syrgkanis, Lester Mackey
knowledge distillation;semiparametric inference;generalization bounds;model compression;cross-fitting;orthogonal machine learning;loss correction
Knowledge Distillation as Semiparametric Inference