cs.AI cs.CL
Direct Preference Optimization Using Sparse Feature-Level Constraints
Qingyu Yin Chak Tou Leong Hongbo Zhang Minjun Zhu Hanqi Yan Qiang Zhang Yulan He Wenjie Li Jun Wang Yue Zhang Linyi Yang