Georgia Institute of Technology; Microsoft
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Jianfeng Gao, Tuo Zhao
Taming Sparsely Activated Transformer with Stochastic Experts