cs.CL cs.AI cs.LG
GRIN: GRadient-INformed MoE
Liyuan Liu Young Jin Kim Shuohang Wang Chen Liang Yelong Shen Hao Cheng Xiaodong Liu Masahiro Tanaka Xiaoxia Wu Wenxiang Hu Vishrav Chaudhary Zeqi Lin Chenruidong Zhang Jilong Xue Hany Awadalla Jianfeng Gao Weizhu Chen