Controllable Language Model;Language Model;Reinforcement Learning;Off-policy RL;Bi-objective Problem;Pareto Optimization
A bi-objective perspective on controllable language models: reward dropout improves off-policy control performance