Google DeepMind; Meta AI & Inria
Gregoire Deletang, Anian Ruoss, Paul-Ambroise Duquenne, Elliot Catt, Tim Genewein, Christopher Mattern, Jordi Grau-Moya, Li Kevin Wenliang, Matthew Aitchison, Laurent Orseau, Marcus Hutter, Joel Veness
lossless compression;arithmetic coding;language models;scaling laws;in-context learning
Language Modeling Is Compression