Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization
Hsieh, Cheng-Yu Chuang, Yung-Sung Li, Chun-Liang Wang, Zifeng Le, Long Kumar, Abhishek Glass, James Ratner, Alex er Lee, Chen-Yu Krishna, Ranjay Pfister, Tomas