University of Bristol; EleutherAI; Apollo Research; EleutherAI, MATS
Robert Huben, Hoagy Cunningham, Logan Smith, Aidan Ewart, Lee Sharkey
language model;interpretability;representation learning;sparsity;dictionary learning;unsupervised learning
Sparse Autoencoders Find Highly Interpretable Features in Language Models