Harbin Institute of Technology; Microsoft Corporation
Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, Furu Wei
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts