Department of Artificial Intelligence, Korea University, Seoul, Republic of Korea; BK21 FOUR R&E Center for Artificial Intelligence, Korea University, Seoul, Republic of Korea; Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
Natural Language Processing;Prompt Tuning;Parameter-Efficient Fine-tuning;Mixture-of-Experts
SMoP: Towards Efficient and Effective Prompt Tuning with Sparse Mixture-of-Prompts