Meta AI; Massachusetts Institute of Technology; Carnegie Mellon University
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
Large Language Models;Length Extrapolation;Efficiency
Efficient Streaming Language Models with Attention Sinks