Duke University; State University of New York at Buffalo; Duke University, Facebook AI; Microsoft Dynamics 365 AI
Kevin Liang, Weituo Hao, Dinghan Shen, Yufan Zhou, Weizhu Chen, Changyou Chen, Lawrence Carin
Natural Language Processing;Representation Learning
MixKD: Towards Efficient Distillation of Large-scale Language Models