The Swiss AI Lab, IDSIA, University of Lugano (USI) & SUPSI, Lugano, Switzerland; The Swiss AI Lab, IDSIA, University of Lugano (USI) & SUPSI, Lugano, Switzerland and King Abdullah University of Science and Technology (KAUST), Thuwal, Saudi Arabia
Robert Csordas, Kazuki Irie, Jürgen Schmidhuber
transformer;compositionality;systematic generalization;algorithmic reasoning;arithmetic
The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization