ILCC, University of Edinburgh, United Kingdom; ILLC, University of Amsterdam, The Netherlands; Department of Computer Science, IT University of Copenhagen, Denmark; Center for Information and Language Processing (CIS), LMU Munich, Germany
Language Modelling;Representation Learning;Learning Dynamics;Probing;Subspace Analysis
Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training