Facebook AI Research; Paul G. Allen School of Computer Science & Engineering, University of Washington
Ofir Press, Noah Smith, Mike Lewis
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation