Machine Learning Department, School of Computer Science, Carnegie Mellon University; National Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University; Center for Data Science, Peking University; Microsoft Research; National Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University
Shengjie Luo, Shanda Li, Shuxin Zheng, Tie-Yan Liu, Liwei Wang, Di He
Transformer;Positional Encoding;Expressive Power
Your Transformer May Not be as Powerful as You Expect