cs.CL cs.AI cs.LG
Upcycling Large Language Models into Mixture of Experts
Ethan He Abhinav Khattar Ryan Prenger Vijay Korthikanti Zijie Yan Tong Liu Shiqing Fan Ashwath Aithal Mohammad Shoeybi Bryan Catanzaro