National University of Singapore; South China University of Technology; ByteDance Inc.
Sucheng Ren; Daquan Zhou; Shengfeng He; Jiashi Feng; Xinchao Wang
Shunted Self-Attention via Multi-Scale Token Aggregation