Salesforce Research, University of Illinois at Urbana-Champaign; Salesforce Research
Jesse Vig, Ali Madani, Lav R Varshney, Caiming Xiong, Richard Socher, Nazneen Rajani
interpretability;black box;computational biology;representation learning;attention;transformers;visualization;natural language processing
BERTology Meets Biology: Interpreting Attention in Protein Language Models