Department of Statistics, University of Oxford; OATML, Department of Computer Science, University of Oxford; Cohere; OATML, Department of Computer Science, University of Oxford
Jannik Kossen, Neil Band, Clare Lyle, Aidan Gomez, Thomas Rainforth, Yarin Gal
attention;self-attention;transformers;multi-head self-attention;dot-product attention;equivariant;equivariance;invariant;invariance;interactions;tabular;supervised learning;masking
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning