Carnegie Mellon University; University of California, Berkeley; Microsoft
Don Dennis, Abhishek Shetty, Anish Prasad Sevekari, Kazuhito Koishida, Virginia Smith
Edge computing;compression;efficient inference;distillation and inference;run-time tradeoff;inference-time tradeoff;on-device;user-side;client-side
Progressive Ensemble Distillation: Building Ensembles for Efficient Inference