Department of Computer Science, University of Sheffield, United Kingdom
multi-head attention; memory efficiency
Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention