Department of Computer Science, Tufts University, Medford, MA 02155; Department of Computer Science, Cornell University, Ithaca, NY 14850
Xiaohui Chen, Yinkai Wang, Yuanqi Du, Soha Hassoun, Liping Liu
Transformer;Self-supervised Learning;Normalization
On Separate Normalization in Self-supervised Transformers