Courant Institute, New York University, New York, NY 10012; Department of Computer Science, Columbia University, New York, NY 10027
Clayton Sanford, Daniel Hsu, Matus Telgarsky, Matus Telgarsky
self-attention;approximation theory;communication complexity
Representational Strengths and Limitations of Transformers