Uploaded model

  • Developed by: SongTonyLi
  • License: apache-2.0
  • Finetuned from model : SongTonyLi/SFT_D1chosen_math_cosineLR_instruct

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
3
Safetensors
Model size
8.03B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for SongTonyLi/SFT_D1chosenThenDPO_D2a_Instruct_argilla_math_results

Finetuned
(2)
this model