Department of Mathematics, National University of Singapore, Singapore; Department of Electrical & Computer Engineering, Rice University, Houston, USA
Tam Nguyen, Tan Nguyen, Richard Baraniuk
transformers;self-attention;total variation;nonlocal functionals;over-smoothing
Mitigating Over-smoothing in Transformers via Regularized Nonlocal Functionals