Language Technologies Institute, Carnegie Mellon University, USA; Tencent AI Lab, China; School of Engineering, Westlake University, China
Language Model; Inference Strategy; Long-context Modeling
TRAMS: Training-free Memory Selection for Long-range Language Modeling