Apple
Dan Busbridge, Jason Ramapuram, Pierre Ablin, Tatiana Likhomanenko, Eeshan Gunesh Dhekane, Xavier Suau Cuadros, Russell Webb
Optimization;scaling rules;EMA;exponential moving average;self-supervised learning;pseudo-labelling;semi-supervised learning;BYOL;distillation;speech;vision
How to Scale Your EMA