Stanford University; University of Illinois Urbana-Champaign; Microsoft Research; UC Berkeley
Mert Yuksekgonul, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi
interpretability;factual errors;hallucinations;attention;large language models
Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models