The University of Texas at Austin; University of Massachusetts Amherst; University of California, Berkeley; Massachusetts Institute of Technology; Google
Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Zhao, Hongkun Yu, Kurt Keutzer, trevor darrell, Denny Zhou
MoE;Instruction Tuning
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models