Meta AI; University of Washington, Allen Institute for AI; Meta AI, University of Washington
Weijia Shi, Sewon Min, Maria Lomeli, Chunting Zhou, Margaret Li, Xi Lin, Noah Smith, Luke Zettlemoyer, Scott Yih, Mike Lewis
Large Language Models
In-Context Pretraining: Language Modeling Beyond Document Boundaries