Carnegie Mellon University; University of California, Berkeley; Gatsby Unit, UCL; Google DeepMind; Gatsby Unit, UCLA
Ted Moskovitz, Aaditya Singh, DJ Strouse, Tuomas Sandholm, Ruslan Salakhutdinov, Anca Dragan, Stephen McAleer
rlhf;overoptimization;constrained RL
Confronting Reward Model Overoptimization with Constrained RLHF