University of Cambridge & Alan Turing Institute; DeepMind & Stanford University; University of Cambridge; Google Brain & Columbia University; Google Brain
Valerii Likhosherstov, Krzysztof Choromanski, Jared Quincy Davis, Xingyou Song, Adrian Weller
transformer;performer;slim-performer;memory efficient;linear transformer
Sub-Linear Memory: How to Make Performers SLiM