Carnegie Mellon University, USA; Carnegie Mellon University, USA∗Now at Google DeepMind
Amanda Bertsch, Uri Alon, Graham Neubig, Matthew Gormley
retrieval augmentation;summarization;long-context;generation;long-input;encoder-decoder;transformers;language models;natural language generation;natural language processing;deep learning;neural networks
Unlimiformer: Long-Range Transformers with Unlimited Length Input