♣Moscow Institute of Physics and Technology, Russia; ‡Hugging Face, USA; ♦University of Toronto, Canada; †Yandex, Russia; ♥HSE University, Russia
Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, quentin lhoest, Anton Sinitsin, Dmitry Popov, Dmitry V. Pyrkin, Maxim Kashirin, Alexander Borzunov, Albert Villanova del Moral, Denis Mazur, Ilia Kobelev, Yacine Jernite, Thomas Wolf, Gennady Pekhimenko
distributed training;volunteer computing;heterogeneous hardware;self-supervised pretraining;transfer learning
Distributed Deep Learning In Open Collaborations