MoonRide commited on
Commit
8e8cc37
·
verified ·
1 Parent(s): 30c3794

Adding Evaluation Results (#1)

Browse files

- Adding Evaluation Results (7ae01ff25710a4b7458c25cb6d745547eefddb62)

Files changed (1) hide show
  1. README.md +117 -8
README.md CHANGED
@@ -1,15 +1,8 @@
1
  ---
2
- base_model:
3
- - meta-llama/Llama-3.2-3B
4
- - bunnycore/Llama-3.2-3B-Mix-Skill
5
- - bunnycore/Llama-3.2-3B-Sci-Think
6
- - FuseAI/FuseChat-Llama-3.2-3B-Instruct
7
- - theprint/ReWiz-Llama-3.2-3B
8
  language:
9
  - en
10
- library_name: transformers
11
  license: llama3.2
12
- pipeline_tag: text-generation
13
  tags:
14
  - facebook
15
  - meta
@@ -20,6 +13,108 @@ tags:
20
  - merge
21
  - chat
22
  - moonride
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ---
24
  <img src="https://huggingface.co/MoonRide/Llama-3.2-3B-Khelavaster/resolve/main/Khelavaster.jpg">
25
 
@@ -60,3 +155,17 @@ dtype: float32
60
  out_dtype: float16
61
 
62
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
 
 
 
 
2
  language:
3
  - en
 
4
  license: llama3.2
5
+ library_name: transformers
6
  tags:
7
  - facebook
8
  - meta
 
13
  - merge
14
  - chat
15
  - moonride
16
+ base_model:
17
+ - meta-llama/Llama-3.2-3B
18
+ - bunnycore/Llama-3.2-3B-Mix-Skill
19
+ - bunnycore/Llama-3.2-3B-Sci-Think
20
+ - FuseAI/FuseChat-Llama-3.2-3B-Instruct
21
+ - theprint/ReWiz-Llama-3.2-3B
22
+ pipeline_tag: text-generation
23
+ model-index:
24
+ - name: Llama-3.2-3B-Khelavaster
25
+ results:
26
+ - task:
27
+ type: text-generation
28
+ name: Text Generation
29
+ dataset:
30
+ name: IFEval (0-Shot)
31
+ type: HuggingFaceH4/ifeval
32
+ args:
33
+ num_few_shot: 0
34
+ metrics:
35
+ - type: inst_level_strict_acc and prompt_level_strict_acc
36
+ value: 49.25
37
+ name: strict accuracy
38
+ source:
39
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MoonRide/Llama-3.2-3B-Khelavaster
40
+ name: Open LLM Leaderboard
41
+ - task:
42
+ type: text-generation
43
+ name: Text Generation
44
+ dataset:
45
+ name: BBH (3-Shot)
46
+ type: BBH
47
+ args:
48
+ num_few_shot: 3
49
+ metrics:
50
+ - type: acc_norm
51
+ value: 22.69
52
+ name: normalized accuracy
53
+ source:
54
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MoonRide/Llama-3.2-3B-Khelavaster
55
+ name: Open LLM Leaderboard
56
+ - task:
57
+ type: text-generation
58
+ name: Text Generation
59
+ dataset:
60
+ name: MATH Lvl 5 (4-Shot)
61
+ type: hendrycks/competition_math
62
+ args:
63
+ num_few_shot: 4
64
+ metrics:
65
+ - type: exact_match
66
+ value: 16.16
67
+ name: exact match
68
+ source:
69
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MoonRide/Llama-3.2-3B-Khelavaster
70
+ name: Open LLM Leaderboard
71
+ - task:
72
+ type: text-generation
73
+ name: Text Generation
74
+ dataset:
75
+ name: GPQA (0-shot)
76
+ type: Idavidrein/gpqa
77
+ args:
78
+ num_few_shot: 0
79
+ metrics:
80
+ - type: acc_norm
81
+ value: 3.69
82
+ name: acc_norm
83
+ source:
84
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MoonRide/Llama-3.2-3B-Khelavaster
85
+ name: Open LLM Leaderboard
86
+ - task:
87
+ type: text-generation
88
+ name: Text Generation
89
+ dataset:
90
+ name: MuSR (0-shot)
91
+ type: TAUR-Lab/MuSR
92
+ args:
93
+ num_few_shot: 0
94
+ metrics:
95
+ - type: acc_norm
96
+ value: 5.5
97
+ name: acc_norm
98
+ source:
99
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MoonRide/Llama-3.2-3B-Khelavaster
100
+ name: Open LLM Leaderboard
101
+ - task:
102
+ type: text-generation
103
+ name: Text Generation
104
+ dataset:
105
+ name: MMLU-PRO (5-shot)
106
+ type: TIGER-Lab/MMLU-Pro
107
+ config: main
108
+ split: test
109
+ args:
110
+ num_few_shot: 5
111
+ metrics:
112
+ - type: acc
113
+ value: 23.57
114
+ name: accuracy
115
+ source:
116
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MoonRide/Llama-3.2-3B-Khelavaster
117
+ name: Open LLM Leaderboard
118
  ---
119
  <img src="https://huggingface.co/MoonRide/Llama-3.2-3B-Khelavaster/resolve/main/Khelavaster.jpg">
120
 
 
155
  out_dtype: float16
156
 
157
  ```
158
+
159
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
160
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/MoonRide__Llama-3.2-3B-Khelavaster-details)
161
+
162
+ | Metric |Value|
163
+ |-------------------|----:|
164
+ |Avg. |20.14|
165
+ |IFEval (0-Shot) |49.25|
166
+ |BBH (3-Shot) |22.69|
167
+ |MATH Lvl 5 (4-Shot)|16.16|
168
+ |GPQA (0-shot) | 3.69|
169
+ |MuSR (0-shot) | 5.50|
170
+ |MMLU-PRO (5-shot) |23.57|
171
+