Under double-blind review
Self attention;sequence-to-sequence function;orthogonal equivairance;permutation equivariance
Why Self Attention is Natural for Sequence-to-Sequence Problems? A Perspective from Symmetries