Facebook AI; LTI, CMU; ISI, USC
Xuezhe Ma, Xiang Kong, Sinong Wang, Chunting Zhou, Jonathan May, Hao Ma, Luke Zettlemoyer
Efficient Attention;Transformer;Linear Attention
Luna: Linear Unified Nested Attention