Spoken Language Systems (LSV), Saarland Informatics Campus, Saarland University; Theory of Machine Learning Lab, École polytechnique fédérale de Lausanne
Marius Mosbach, Maksym Andriushchenko, Dietrich Klakow
fine-tuning stability;transfer learning;pretrained language model;BERT
On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines