David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, Canada; David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, Canada; Vector Institute, Toronto, Canada
Autoencoders;Contrastive;Transformers
Contrastive Deterministic Autoencoders For Language Modeling