Mila, Université de Montréal; Apple; Apple, Tel Aviv University
Noam Razin, Hattie Zhou, Omid Saremi, Vimal Thilak, Arwen Bradley, Preetum Nakkiran, Joshua Susskind, Etai Littwin
Vanishing Gradients;Reinforcement Finetuning;Supervised Finetuning;Language Models
Vanishing Gradients in Reinforcement Finetuning of Language Models