FAIR, Meta; Flatiron Institute
Alberto Bietti, Vivien Cabannes, Diane Bouchacourt, Herve Jegou, Leon Bottou
transformers;language models;deep learning theory;interpretability
Birth of a Transformer: A Memory Viewpoint