Indraprastha Institute of Information Technology Delhi, India; Indian Institute of Technology Delhi, India
Ayan Sengupta, Shantanu Dixit, Md Shad Akhtar, Tanmoy Chakraborty
Knowledge Distillation;Meta-Knowledge Distillation;Policy-driven Knowledge Distillation;Large Language Models
A Good Learner can Teach Better: Teacher-Student Collaborative Knowledge Distillation