Carnegie Mellon University; Microsoft Research NYC; University of Pennsylvania
Bingbin Liu, Jordan Ash, Surbhi Goel, Akshay Krishnamurthy, Cyril Zhang
Transformer;self-attention;group theory;semigroup theory;algebraic automata theory;shortcut learning;theory of deep learning
Transformers Learn Shortcuts to Automata