University of Oxford; Meta; University College London
Robert Kirk, Ishita Mediratta, Christoforos Nalmpantis, Jelena Luketina, Eric Hambro, Edward Grefenstette, Roberta Raileaneu pdfimportantwords=Reinforcement Learning, Imitation Learning, Language Models, Fine Tuning
reinforcement learning;large language models;rlhf;ood generalisation;diversity
Understanding the Effects of RLHF on LLM Generalisation and Diversity