KAIST; University of Illinois Chicago; LG AI Research; LG AI Research and KAIST
Sungjun Cho, Seonwoo Min, Jinwoo Kim, Moontae Lee, Honglak Lee, Seunghoon Hong
Efficient Transformers;Sparse Attention;Stochastic Block Model
Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost