ESAT-STADIUS, KU Leuven, Belgium
Yingyi Chen, Qinghua Tao, Francesco Tonin, Johan Suykens
Self-attention;primal-dual representations;SVD;kernel method;asymmetry;transformer
Primal-Attention: Self-attention through Asymmetric Kernel SVD in Primal Representation