Department of Computer Science and Electrical Engineering, University of Maryland, Baltimore County, Baltimore, MD, USA; Booz Allen Hamilton, McLean, VA, USA; Laboratory for Physical Sciences, College Park, MD, USA; Booz Allen Hamilton, McLean, VA, USA; Laboratory for Physical Sciences, College Park, MD, USA; Booz Allen Hamilton, McLean, VA, USA; EleutherAI
Mohammad Mahmudul Alam, Edward Raff, Stella Biderman, Tim Oates, James Holt
Recasting Self-Attention with Holographic Reduced Representations