Google Research, University of Southern California; Google Research
efficient nlp;multi-query attention;fast inference
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints