Fangyu Liu, Yunlong Jiao, Jordan Massiah, Emine Yilmaz, Serhii Havrylov
self-supervised learning;sentence embeddings;sentence representations;knowledge distillation
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations