Department of Computer Science, University of Sheffield, UK
LLMs;Interpretability;Pretraining
Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance?