University of British Columbia; University of British Columbia, Vector Institute for AI
Sadegh Mahdavi, Renjie Liao, Christos Thrampoulidis
Learning Theory;Expressivity;Multi-Head Attention;Transformers
Memorization Capacity of Multi-Head Attention in Transformers