School of Computer Science and Engineering, Beihang University, China; Department of Computer Science, University of Manchester, United Kingdom; Faculty of Information Technology, Beijing University of Technology, China
Pre-trained Language Models;Transfer Learning;Transferability Estimation;Model Selection
How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey