cs.CL 68T50 I.2.7
TIS-DPO: Token-level Importance Sampling for Direct Preference Optimization With Estimated Weights
Aiwei Liu Haoping Bai Zhiyun Lu Yanchao Sun Xiang Kong Simon Wang Jiulong Shan Albin Madappally Jose Xiaojiang Liu Lijie Wen Philip S. Yu Meng Cao