Meta AI; Reka AI; UCL Centre for Artificial Intelligence; Cohere AI
Yihong Chen, Kelly Marchisio, Roberta Raileanu, David Adelani, Pontus Lars Erik Saito Stenetorp, Sebastian Riedel, Mikel Artetxe
plasticity;continual learning;meta-learning;embeddings;cross-lingual transfer;forgetting
Improving Language Plasticity via Pretraining with Active Forgetting