Sun Yat-sen University; University of Glasgow; Mohamed bin Zayed University of Artificial Intelligence; DAMO Academy, Alibaba Group
Guanzheng Chen, Xin Li, Zaiqiao Meng, Shangsong Liang, Lidong Bing
Length Extrapolation;Long Context;Large Language Model (LLM);Neural Ordinary Differential Equation (ODE)
CLEX: Continuous Length Extrapolation for Large Language Models