ComPO
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
This repo contains all the models for paper -
ComPO: Preference Alignment via Comparison Oracles
https://arxiv.org/abs/2505.05465
Please cite
@misc{chen2025compopreferencealignmentcomparison,
title={ComPO: Preference Alignment via Comparison Oracles},
author={Peter Chen and Xi Chen and Wotao Yin and Tianyi Lin},
year={2025},
eprint={2505.05465},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2505.05465},
}
models
18

ComparisonPO/Mistral-7B-Instruct-A0.21B-ComPO
7B
•
Updated
•
9

ComparisonPO/Mistral-7B-Instruct-ComPO-3300pert-300iter-2
7B
•
Updated
•
11

ComparisonPO/Mistral-7B-Instruct-ComPO-3300pert-300iter
7B
•
Updated
•
10

ComparisonPO/Gemma-2-9b-it-SimPO-ComPO
9B
•
Updated
•
12

ComparisonPO/Mistral-Instruct-7B-SimPO-ComPO
7B
•
Updated
•
7

ComparisonPO/Llama-3-Instruct-8B-SimPO-ComPO
8B
•
Updated
•
7

ComparisonPO/Llama-3-Base-8B-DPO-ComPO
8B
•
Updated
•
5

ComparisonPO/Llama-3-Instruct-8B-DPO-ComPO
8B
•
Updated
•
9

ComparisonPO/Llama-3-Base-8B-DPO_clean
8B
•
Updated
•
5

ComparisonPO/Mistral-Base-7B-DPO
7B
•
Updated
•
7
•
2
datasets
0
None public yet