Neural Networks and Deep Learning Lab, Moscow Institute of Physics and Technology, Dolgoprudny, Russia; AIRI, Moscow, Russia; Neural Networks and Deep Learning Lab, Moscow Institute of Physics and Technology, Dolgoprudny, Russia
Aydar Bulatov, Yury Kuratov, Mikhail Burtsev
memory augmented models;transformers;self-attention;recurrence
Recurrent Memory Transformer