University of Southern California; Beihang University
Wangchunshu Zhou, Dong-Ho Lee, Ravi Kiran Selvam, Seyeon Lee, Xiang Ren
Language Model Pre-training;Commonsense Reasoning;Self-supervised Learning
Pre-training Text-to-Text Transformers for Concept-centric Common Sense