Stanford University; Google Research, Brain Team
Hongyu Ren, Hanjun Dai, Zihang Dai, Mengjiao (Sherry) Yang, Jure Leskovec, Dale Schuurmans, Bo Dai
Transformer;long sequence modeling;conditional expectation factorization;full attention
Combiner: Full Attention Transformer with Sparse Computation Cost