Department of Mathematics, Aarhus University
Kenneth Borup, Lars N. Andersen
Knowledge Distillation;Self Distillation;Kernel Ridge Regression;Statistical Learning;Theory
Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation