Microsoft Research Montreal; MILA, Université de Montréal CIFAR Senior Fellow; Carnegie Mellon University; Microsoft Research Montreal Carnegie Mellon University
Mariya Toneva, Alessandro Sordoni, Remi Combes, Adam Trischler, Yoshua Bengio, Geoffrey Gordon
catastrophic forgetting;sample weighting;deep generalization
An Empirical Study of Example Forgetting during Deep Neural Network Learning