University of Kaiserslautern-Landau & Max-Planck Institute for Software Systems, Kaiserslautern, Germany; Tufts University, Medford, USA; IMFD and CENIA, Santiago, Chile; IMC, PUC Chile & IMFD Chile & CENIA, Santiago, Chile
Pablo Barcelo, Alexander Kozachinskiy, Anthony W. Lin, Vladimir Podolskii
transformer encoders;languages;AC0;first order logic;linear temporal logic;counting terms;parity;majority
Logical Languages Accepted by Transformer Encoders with Hard Attention