Huawei Noah’s Ark Lab; Department of Statistics and Actuarial Science, The University of Hong Kong
Feiqing Huang, Kexin Lu, Yuxi Cai, Zhen Qin, Yanwen Fang, Guangjian Tian, Guodong Li
Recurrent models;Transformers;sample efficiency;gated mechanism
Encoding Recurrence into Transformers