Model Overview
This model has been fine-tuned using the The Second Iteration of GSM8K Preference Dataset with the Direct Preference Optimization algorithm. The goal of this fine-tuning is to enhance the model's performance in solving arithmetic problems on the GSM8K benchmark.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no pipeline_tag.