Princeton University; Carnegie Mellon University
Transformer;Algorithmic reasoning;Length extrapolation;Working memory
Transformer Working Memory Enables Regular Language Reasoning And Natural Language Length Extrapolation