Google DeepMind; Google Research
Sneha Kudugunta, Isaac Caswell, Biao Zhang, Xavier Garcia, Derrick Xin, Aditya Kusupati, Romi Stella, Ankur Bapna, Orhan Firat
CommonCrawl;Low Resource Languages;Underrepresented Languages;Multilinguality;LLMs;Large Language Models;Machine Translation
MADLAD-400: A Multilingual And Document-Level Large Audited Dataset