University of Washington; University of Washington⇧Allen Institute for AI
Thao Nguyen
robustness;out-of-distribution shifts;finetuning;pretraining
On the Connection between Pre-training Data Diversity and Fine-tuning Robustness