cs.LG
Hybrid Preference Optimization for Alignment: Provably Faster Convergence Rates by Combining Offline Preferences with Online Exploration
Avinandan Bose Zhihan Xiong Aadirupa Saha Simon Shaolei Du Maryam Fazel