DeepMind, Stanford University; University College London; DeepMind
Stephanie Chan, Adam Santoro, Andrew Lampinen, Jane Wang, Aaditya Singh, Pierre Richemond, James McClelland, Felix Hill
in-context learning;few-shot learning;transformers
Data Distributional Properties Drive Emergent In-Context Learning in Transformers