The University of Hong Kong; Apple Inc.; ByteDance Inc.
Lin Zheng, Jianbo Yuan, Chong Wang, Lingpeng Kong
attention mechanism;transformers;random features;control variates;importance sampling
Efficient Attention via Control Variates