Meta AI; University of Illinois Urbana-Champaign
Yu Meng, Jitin Krishnan, Sinong Wang, Qifan Wang, Yuning Mao, Han Fang, Marjan Ghazvininejad, Jiawei Han, Luke Zettlemoyer
Masked Language Modeling
Representation Deficiency in Masked Language Modeling