cs.LG cs.AI cs.CL
Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
Karel D'Oosterlinck Winnie Xu Chris Develder Thomas Demeester Amanpreet Singh Christopher Potts Douwe Kiela Shikib Mehri