Department of Electrical and Computer Engineering, The University of Texas at Austin
Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang
Deep ViT;Spectral Analysis;Attention Collapse;Patch Diversity
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice