cs.CL
Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models
Zhisong Zhang Yan Wang Xinting Huang Tianqing Fang Hongming Zhang Chenlong Deng Shuaiyi Li Dong Yu