Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking
Jacob Eisenstein Chirag Nagpal Alekh Agarwal Ahmad Beirami Alexander Nicholas D'Amour Krishnamurthy Dj Dvijotham Adam Fisch Katherine A Heller Stephen Robert Pfohl Deepak Ramachandran Peter Shaw Jonathan Berant