Google DeepMind; Google Research
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
Transformers;Attention;Deep Learning
Long Range Arena : A Benchmark for Efficient Transformers