University of Illinois Urbana-Champaign
Yifan Chen, Qi Zeng, Heng Ji, Yun Yang
efficient transformers;attention;NLP applications
Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method