DatologyAI; Meta AI (FAIR); ELLIS Institute Tübingen, Max-Planck Institute for Intelligent Systems, Tübingen AI Center; University of California San Diego; University of Tübingen, Germany
Amro Kamal, Evgenia Rusak, Kushal Tirumala, Wieland Brendel, Kamalika Chaudhuri, Ari Morcos
pruning;large-scale;data curation;concept-based;LAION;DataComp
Effective pruning of web-scale datasets based on complexity of concept clusters