Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
dfrees
/
llama-1b-instruct-dpo
like
0
PEFT
Safetensors
llama
4-bit precision
bitsandbytes
arxiv:
1910.09700
Model card
Files
Files and versions
Community
Train
Use this model
main
llama-1b-instruct-dpo
/
README.md
Commit History
Uploading merged DPO-trained model
411221a
verified
dfrees
commited on
Oct 8, 2024
initial commit
44f4e52
verified
dfrees
commited on
Oct 8, 2024