Hugging Face's logo

chenggong1995
/
Qwen2.5-3B-Instruct-grpo-E6-D100-L4096-lr5e7

Text Generation
Transformers
Safetensors
qwen2
Generated from Trainer
trl
grpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
chenggong1995 commited on
Commit
7086a1b
·
verified ·
1 Parent(s): bc08739

Model save

Browse files
Files changed (5) hide show
  1. README.md +1 -1
  2. all_results.json +3 -3
  3. train_results.json +3 -3
  4. trainer_state.json +3 -3
  5. training_args.bin +1 -1
README.md CHANGED
@@ -27,7 +27,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/gongc1995-city-university-of-hong-kong/huggingface/runs/jc48omk4)
31
 
32
 
33
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/gongc1995-city-university-of-hong-kong/huggingface/runs/030g7nqs)
31
 
32
 
33
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
all_results.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
  "total_flos": 0.0,
3
  "train_loss": 0.0,
4
- "train_runtime": 1.735,
5
  "train_samples": 100,
6
- "train_samples_per_second": 172.91,
7
- "train_steps_per_second": 1.729
8
  }
 
1
  {
2
  "total_flos": 0.0,
3
  "train_loss": 0.0,
4
+ "train_runtime": 1.6197,
5
  "train_samples": 100,
6
+ "train_samples_per_second": 185.223,
7
+ "train_steps_per_second": 1.852
8
  }
train_results.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
  "total_flos": 0.0,
3
  "train_loss": 0.0,
4
- "train_runtime": 1.735,
5
  "train_samples": 100,
6
- "train_samples_per_second": 172.91,
7
- "train_steps_per_second": 1.729
8
  }
 
1
  {
2
  "total_flos": 0.0,
3
  "train_loss": 0.0,
4
+ "train_runtime": 1.6197,
5
  "train_samples": 100,
6
+ "train_samples_per_second": 185.223,
7
+ "train_steps_per_second": 1.852
8
  }
trainer_state.json CHANGED
@@ -13,9 +13,9 @@
13
  "step": 3,
14
  "total_flos": 0.0,
15
  "train_loss": 0.0,
16
- "train_runtime": 1.735,
17
- "train_samples_per_second": 172.91,
18
- "train_steps_per_second": 1.729
19
  }
20
  ],
21
  "logging_steps": 5,
 
13
  "step": 3,
14
  "total_flos": 0.0,
15
  "train_loss": 0.0,
16
+ "train_runtime": 1.6197,
17
+ "train_samples_per_second": 185.223,
18
+ "train_steps_per_second": 1.852
19
  }
20
  ],
21
  "logging_steps": 5,
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:301be5dbaaf46d2b49510d710e0c7a4f05c037a46d8b8c5c245770656f8cfe21
3
  size 8056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:651146bee58ac2427d8774c7bd97b22eae3ee472643bad7a02525bb44fd56e70
3
  size 8056