Redwood Research (Work performed during an internship. Now at Conjecture); University of Southern California; ILLC, University of Amsterdam
Michael Hanna, Ollie Liu, Alexandre Variengien
interpretability;language models;NLP
How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model