Aleph Alpha, Technical University Darmstadt, Hessian Center for Artificial Intelligence (hessian.AI), German Center for Artificial Intelligence (DFKI); Technical University Darmstadt, Hessian Center for Artificial Intelligence (hessian.AI), German Center for Artificial Intelligence (DFKI); German Center for Artificial Intelligence (DFKI), LAION; Technical University Darmstadt, Hessian Center for Artificial Intelligence (hessian.AI), German Center for Artificial Intelligence (DFKI), LAION
Björn Deiseroth, Mayukh Deb, Samuel Weinbach, Manuel Brack, Patrick Schramowski, Kristian Kersting
explainability;attention manipulation;perturbation;large language model;multi-modality;generative decoder;efficiency;transformer
ATMAN: Understanding Transformer Predictions Through Memory Efficient Attention Manipulation