University of Tübingen; Department of Applied Physics, Stanford University; Meta AI (FAIR)
Ben Sorscher, Robert Geirhos, Shashank Shekhar, Surya Ganguli, Ari Morcos
data pruning;neural scaling;data subsetting;replicate theory
Beyond neural scaling laws: beating power law scaling via data pruning