Google Deepmind; U. Toronto & Vector Institute; OpenAI; Google Research
Dami Choi, Derrick Xin, Hamid Dadkhahi, Justin Gilmer, Ankush Garg, Orhan Firat, Chih-Kuan Yeh, Andrew Dai, Behrooz Ghorbani
Multitask Optimization;Multilingual;Pre-training;Language Models;Language Sampling;Low Resource Languages;Overfitting
Order Matters in the Presence of Dataset Imbalance for Multilingual Learning