CSE Department, Michigan State University, East Lansing, MI; CSE Department, University of Michigan, Ann Arbor, MI
Junghwan Kim, Michelle Kim, Barzan Mozafari
Transformer;Expressivness;Memorization;Deep learning theory;contextual mapping;permutation equivariance
Provable Memorization Capacity of Transformers