cs.CL cs.LG
An Wang Xingwu Sun Ruobing Xie Shuaipeng Li Jiaqi Zhu Zhen Yang Pinxue Zhao J. N. Han Zhanhui Kang Di Wang Naoaki Okazaki Cheng-zhong Xu
HMoE: Heterogeneous Mixture of Experts for Language Modeling