Microsoft Research at Redmond; Microsoft Cloud + AI
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
Focal Attention;Self-Attention;Long-range Interactions;Local-Global Interactions;Vision Transformer;Image Classification;Object Detection
Focal Attention for Long-Range Interactions in Vision Transformers