Google; Google DeepMind; Google Brain
Rohan Anil, Gabriel Pereyra, Alexandre Tachard Passos, Robert Ormandi, George Dahl, Geoffrey E Hinton
distillation;distributed training;neural networks;deep learning
Large scale distributed neural network training through online distillation