Department of Computer Science, The University of Hong Kong; School of Computer Science & Engineering, Hebrew University of Jerusalem; Paul G. Allen School of Computer Science & Engineering, University of Washington; DeepMind
Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah Smith, Lingpeng Kong
Attention;transformers;machine translation;language modeling
Random Feature Attention