Text Generation
Transformers
PyTorch
Safetensors
English
Chinese
llama
axolotl
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
leaderboard-pr-bot commited on
Commit
4bb35bb
·
verified ·
1 Parent(s): d2578eb

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +21 -7
README.md CHANGED
@@ -1,19 +1,19 @@
1
  ---
 
 
 
2
  license: llama3
3
- base_model: meta-llama/Meta-Llama-3-8B
4
  tags:
5
  - axolotl
6
  - generated_from_trainer
7
- model-index:
8
- - name: Llama-3-8B-Magpie-Align-SFT-v0.3
9
- results: []
10
  datasets:
11
  - Magpie-Align/Magpie-Reasoning-150K
12
  - Magpie-Align/Magpie-Pro-MT-300K-v0.1
13
  - Magpie-Align/Magpie-Qwen2-Pro-200K-Chinese
14
- language:
15
- - en
16
- - zh
17
  ---
18
 
19
  ![Magpie](https://cdn-uploads.huggingface.co/production/uploads/653df1323479e9ebbe3eb6cc/FWWILXrAGNwWr52aghV0S.png)
@@ -188,3 +188,17 @@ special_tokens:
188
  ```
189
 
190
  </details><br>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - zh
5
  license: llama3
 
6
  tags:
7
  - axolotl
8
  - generated_from_trainer
9
+ base_model: meta-llama/Meta-Llama-3-8B
 
 
10
  datasets:
11
  - Magpie-Align/Magpie-Reasoning-150K
12
  - Magpie-Align/Magpie-Pro-MT-300K-v0.1
13
  - Magpie-Align/Magpie-Qwen2-Pro-200K-Chinese
14
+ model-index:
15
+ - name: Llama-3-8B-Magpie-Align-SFT-v0.3
16
+ results: []
17
  ---
18
 
19
  ![Magpie](https://cdn-uploads.huggingface.co/production/uploads/653df1323479e9ebbe3eb6cc/FWWILXrAGNwWr52aghV0S.png)
 
188
  ```
189
 
190
  </details><br>
191
+
192
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
193
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Magpie-Align__Llama-3-8B-Magpie-Align-SFT-v0.3)
194
+
195
+ | Metric |Value|
196
+ |-------------------|----:|
197
+ |Avg. |17.38|
198
+ |IFEval (0-Shot) |50.64|
199
+ |BBH (3-Shot) |23.70|
200
+ |MATH Lvl 5 (4-Shot)| 6.27|
201
+ |GPQA (0-shot) | 2.13|
202
+ |MuSR (0-shot) | 0.40|
203
+ |MMLU-PRO (5-shot) |21.14|
204
+