Google Research, Blueshift
Vinay Ramasesh, Aitor Lewkowycz, Ethan Dyer
Catastrophic forgetting;continual learning;scaling;language modeling;image classification
Effect of scale on catastrophic forgetting in neural networks