SenseTime Research; Xi’an Jiaotong University; Tsinghua University; Shanghai AI Laboratory; The Chinese University of Hong Kong
Jinguo Zhu, Xizhou Zhu, Wenhai Wang, Xiaohua Wang, Hongsheng Li, Xiaogang Wang, Jifeng Dai
Generalist Models;Task Interference;Mixture of Experts
Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs