Protein Structure;Proteins;Contact Prediction;Representation Learning;Language Modeling;Attention;Transformer;BERT;Markov Random Fields;Potts Models;Self-supervised learning
Single Layers of Attention Suffice to Predict Protein Contacts