Tencent AI Lab; Johns Hopkins University; University of Pennsylvania
Lingfeng Shen, Sihao Chen, Linfeng Song, Lifeng Jin, Baolin Peng, Haitao Mi, Daniel Khashabi, Dong Yu
Large language model;reward model;RLHF;consistency
The Trickle-down Impact of Reward Inconsistency on RLHF