Mila, Université de Montréal, Polytechnique Montréal; Google DeepMind
Jonathan Pilault, Mahan Fathi, Orhan Firat, Chris Pal, Pierre-Luc Bacon, Ross Goroshin
State Space Models;Efficient Transformers;Long Range Language Modeling;Language Modeling
Block-State Transformers