Hugging Face's logo

shirwu
/
content

PEFT
Safetensors
trl
dpo
Generated from Trainer
Model card Files Community
content / .config /.last_opt_in_prompt.yaml

Commit History

shirwu/dpo-personal-preference-llama3.2-1b-trainer
e0257e3
verified

shirwu commited on