metadata

base_model:
  - meta-llama/Llama-3.2-3B-Instruct
datasets:
  - songff/GenerAlign
language:
  - en
license: apache-2.0
pipeline_tag: text-generation
library_name: transformers

Pilot-3B is designed to be a draft model in efficient preference alignment of LLMs for its small size while high performance in general domains. It is trained from Llama-3.2-3B-Instruct on GenerAlign.

⚠️Caution

Pilot-3B is not guaranteed always to provide safe and correct responses. Please use it at your own risk.

Citation

If you find this work useful, please consider citing:

@misc{song2025well,
  title={Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding},
  author={Song, Feifan and Wei, Shaohang and Luo, Wen and Fan, Yuxuan and Liu, Tianyu and Wang, Guoyin and Wang, Houfeng},
  year={2025},
  eprint={2506.07434},
  archivePrefix={arXiv},
  primaryClass={cs.CL}
}