cs.LG cs.DC
Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training
Jared Fernandez Luca Wehrstedt Leonid Shamis Mostafa Elhoushi Kalyan Saladi Yonatan Bisk Emma Strubell Jacob Kahn