Worcester Polytechnic Institute; Amazon Alexa AI
Yichuan Li, Xiyao Ma, Sixing Lu, Kyumin Lee, Xiaohu Liu, Chenlei Guo
in-context learning;language modeling;data distillation;knowledge distillation
MEND: Meta Demonstration Distillation for Efficient and Effective In-Context Learning