The University of Hong Kong; Hong Kong University of Science and Technology; Sun Yat-sen University; Huawei Noah’s Ark Lab
Han Shi, JIAHUI GAO, Hang Xu, Xiaodan Liang, Zhenguo Li, Lingpeng Kong, Stephen Lee, James Kwok
BERT;Over-smoothing;Transformer
Revisiting Over-smoothing in BERT from the Perspective of Graph