Under double-blind review
machine learning;large language models;metrics;data diversity;data;data quality
Beyond Scale: the Diversity Coefficient as a Data Quality Metric Demonstrates LLMs are Pre-trained on Formally Diverse Data