leaderboard-pr-bot commited on
Commit
8a6d8e8
·
verified ·
1 Parent(s): 02f10f3

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +18 -5
README.md CHANGED
@@ -1,6 +1,8 @@
1
  ---
 
 
 
2
  license: llama3
3
- base_model: Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3
4
  tags:
5
  - alignment-handbook
6
  - axolotl
@@ -8,6 +10,7 @@ tags:
8
  - dpo
9
  - sft
10
  - generated_from_trainer
 
11
  datasets:
12
  - princeton-nlp/llama3-ultrafeedback-armorm
13
  - Magpie-Align/Magpie-Pro-MT-300K-v0.1
@@ -16,9 +19,6 @@ datasets:
16
  model-index:
17
  - name: Magpie-Align/Llama-3-8B-Magpie-Align-v0.3
18
  results: []
19
- language:
20
- - en
21
- - zh
22
  ---
23
 
24
  ![Magpie](https://cdn-uploads.huggingface.co/production/uploads/653df1323479e9ebbe3eb6cc/FWWILXrAGNwWr52aghV0S.png)
@@ -366,4 +366,17 @@ ArmoRM paper:
366
  }
367
  ```
368
 
369
- **Questions?** Please contact [Zhangchen](https://zhangchenxu.com/) by email.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - zh
5
  license: llama3
 
6
  tags:
7
  - alignment-handbook
8
  - axolotl
 
10
  - dpo
11
  - sft
12
  - generated_from_trainer
13
+ base_model: Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3
14
  datasets:
15
  - princeton-nlp/llama3-ultrafeedback-armorm
16
  - Magpie-Align/Magpie-Pro-MT-300K-v0.1
 
19
  model-index:
20
  - name: Magpie-Align/Llama-3-8B-Magpie-Align-v0.3
21
  results: []
 
 
 
22
  ---
23
 
24
  ![Magpie](https://cdn-uploads.huggingface.co/production/uploads/653df1323479e9ebbe3eb6cc/FWWILXrAGNwWr52aghV0S.png)
 
366
  }
367
  ```
368
 
369
+ **Questions?** Please contact [Zhangchen](https://zhangchenxu.com/) by email.
370
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
371
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Magpie-Align__Llama-3-8B-Magpie-Align-v0.3)
372
+
373
+ | Metric |Value|
374
+ |-------------------|----:|
375
+ |Avg. |16.89|
376
+ |IFEval (0-Shot) |44.97|
377
+ |BBH (3-Shot) |24.31|
378
+ |MATH Lvl 5 (4-Shot)| 2.57|
379
+ |GPQA (0-shot) | 2.01|
380
+ |MuSR (0-shot) | 3.74|
381
+ |MMLU-PRO (5-shot) |23.71|
382
+