Unfortunately, this paper is not well written, as there are numerous typos and grammatical errors throughout. Additionally, there is an unfinished sentence present (caption of table 1). Consequently, reading and comprehending the paper becomes quite challenging.
Moreover, there are also numerous imprecise uses of terminology. These misuses create confusion while reading and can hinder future work.
- [241] Eq. (2) involves 2xN _BERT structures_. ---> BERT representations
- [249] we respectively add more noise (+Noise) or reduce some noise (-Noise) from z...
-> we respectively add **more** noise (+Noise) or **less** noise (-Noise) **to** z...
- Is _feature corruption_ the commonly used name for the issue? This name of the issue is not mentioned by Zbontar et al. (2021).
The authors also did not mention whether the source code will be released publicly. This will make the reproduction process much more difficult.
- [241] Eq. (2) involves 2xN _BERT structures_. ---> BERT representations - [249] we respectively add more noise (+Noise) or reduce some noise (-Noise) from z... -> we respectively add **more** noise (+Noise) or **less** noise (-Noise) **to** z...