Naver Labs Europe; Independent Researcher; University of Sussex; Naver Corp, Yonsei University
DONGYOUNG GO, Tomek Korbak, Germàn Kruszewski, Jos Rozen, Marc Dymetman
language model alignment;preference model;Reinforcement Learning from Human Feedback (RLHF);overoptimization;interpretability;scalable oversight;reward hacking
Compositional Preference Models for Aligning LMs