School of Computer Science and Engineering, Sun Yat-sen University, China; Alibaba Group, China; Nyonic AI
Knowledge Distillation;Chain of Thought;Reasoning
MCC-KD: Multi-CoT Consistent Knowledge Distillation