Peng Cheng Laboratory; Sun Yat-sen University; MBZUAI; Institute of Information Science, Beijing Jiaotong University; Beijing Key Laboratory of Advanced Information Science and Network; Peng Cheng Laboratory; Institute of Information Science, Beijing Jiaotong University; Beijing Key Laboratory of Advanced Information Science and Network
Hongguang Zhu, Yunchao Wei, Xiaodan Liang, Chunjie Zhang, Yao Zhao
CTP:Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology Preservation