Tel Aviv University; Apple; Apple; Mila, Université de Montréal
Hattie Zhou, Arwen Bradley, Etai Littwin, Noam Razin, Omid Saremi, Joshua Susskind, Samy Bengio, Preetum Nakkiran
length generalization;systematic generalization;understanding;transformer;scratchpad;LLM;algorithmic reasoning
What Algorithms can Transformers Learn? A Study in Length Generalization