School of Computer Science and Engineering, Nanyang Technological University; School of Computing, National University of Singapore; School of Electrical and Electronic Engineering, Nanyang Technological University; Huawei Noah’s Ark Lab
Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Yongming Chen, Xin Jiang, Yang You
A Study on Transformer Configuration and Training Objective