University of Washington, Snorkel AI, Inc.; University of Washington; HKUST(GZ); USTC
Jieyu Zhang, Bohan Wang, Zhengyu Hu, Pang Wei Koh, Alexander Ratner
data-centric study;supervised pretraining;transfer learning
On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training