Department of Computer Science, University of Maryland, College Park, MD 20740, USA
Xiaoyu Liu, Jiahao Su, Furong Huang
Attention Modules;Transformers;Data-driven Model Design;Trainable Heads;Expressive Power;Tensor Methods.
Tuformer: Data-driven Design of Transformers for Improved Generalization or Efficiency