The Swiss AI Lab, IDSIA, University of Lugano (USI) & SUPSI, Lugano, Switzerland; The Swiss AI Lab, IDSIA, University of Lugano (USI) & SUPSI, Lugano, Switzerland and King Abdullah University of Science and Technology (KAUST), Thuwal, Saudi Arabia
Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber
Transformers;memory augmented recurrent neural networks;fast weight programmers
Going Beyond Linear Transformers with Recurrent Fast Weight Programmers