Shanghai AI Lab; School of Computer Science, Fudan University; School of Computer Science, Fudan University; Shanghai AI Lab
Xiaoran Liu, Hang Yan, Chenxin An, Xipeng Qiu, Dahua Lin
Position Embeddin;Length Extrapolation;Large Language Model;Natural Language Processing
Scaling Laws of RoPE-based Extrapolation