Peking University; Kuaishou Technology
Yang Jin, Kun Xu, Kun Xu, Liwei Chen, Chao Liao, Jianchao Tan, Quzhe Huang, Bin CHEN, Chengru Song, dai meng, Di ZHANG, Wenwu Ou, Kun Gai, Yadong MU
Vision Language Learning;Large Language Model;Pretraining
Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization