Zeren Chen, ziqin wang, zhen wang, Huayang Liu, Zhenfei Yin, Si Liu, Lu Sheng, Wanli Ouyang, Jing Shao
Large Language Model (LLM);Multi-task learning;Multi-modal learning;Mixture-of-Experts (MoE);PEFT
Octavius: Mitigating Task Interference in MLLMs via LoRA-MoE