LTCI, Télécom Paris, Institut Polytechnique de Paris, France; Inria, Soda, Saclay, France
Positional Encodings;Sentence Representations;Pre-trained Language Models
The Locality and Symmetry of Positional Encodings