cs.LG cs.CL
On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimization
Lin, Yong Seto, Skyler Ter Hoeve, Maartje Metcalf, Katherine Theobald, Barry-John Wang, Xuan Zhang, Yizhe Huang, Chen Zhang, Tong