Columbia University, New York, NY, USA; Virginia Tech, Blacksburg, VA, USA; Amazon, Seattle, WA, USA
Feiyang Kang, Hoang Anh Just, Yifan Sun, Himanshu Jahagirdar, Yuanzhi Zhang, Rongxing Du, Anit Kumar Sahu, Ruoxi Jia
Data Selection;Large Language Model;Optimal Transport;Data-centric AI;Data Efficiency
Get more for less: Principled Data Selection for Warming Up Fine-Tuning in LLMs