Hugging Face's logo

wanlige
/
li-14b-v0.4

Text Generation
Transformers
Safetensors
qwen2
mergekit
Merge
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1

Adding Evaluation Results

#1
by wanlige - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+113
-5
Files changed (1) hide show
  1. README.md +113 -5
README.md CHANGED
@@ -1,4 +1,8 @@
1
  ---
 
 
 
 
2
  base_model:
3
  - Qwen/Qwen2.5-14B-Instruct
4
  - Qwen/Qwen2.5-Coder-14B
@@ -7,11 +11,101 @@ base_model:
7
  - tanliboy/lambda-qwen2.5-14b-dpo-test
8
  - SicariusSicariiStuff/Impish_QWEN_14B-1M
9
  - Qwen/Qwen2.5-14B
10
- library_name: transformers
11
- tags:
12
- - mergekit
13
- - merge
14
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  ---
16
  # merge
17
 
@@ -52,3 +146,17 @@ int8_mask: true
52
  dtype: bfloat16
53
 
54
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ tags:
4
+ - mergekit
5
+ - merge
6
  base_model:
7
  - Qwen/Qwen2.5-14B-Instruct
8
  - Qwen/Qwen2.5-Coder-14B
 
11
  - tanliboy/lambda-qwen2.5-14b-dpo-test
12
  - SicariusSicariiStuff/Impish_QWEN_14B-1M
13
  - Qwen/Qwen2.5-14B
14
+ model-index:
15
+ - name: li-14b-v0.4
16
+ results:
17
+ - task:
18
+ type: text-generation
19
+ name: Text Generation
20
+ dataset:
21
+ name: IFEval (0-Shot)
22
+ type: HuggingFaceH4/ifeval
23
+ args:
24
+ num_few_shot: 0
25
+ metrics:
26
+ - type: inst_level_strict_acc and prompt_level_strict_acc
27
+ value: 81.33
28
+ name: strict accuracy
29
+ source:
30
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
31
+ name: Open LLM Leaderboard
32
+ - task:
33
+ type: text-generation
34
+ name: Text Generation
35
+ dataset:
36
+ name: BBH (3-Shot)
37
+ type: BBH
38
+ args:
39
+ num_few_shot: 3
40
+ metrics:
41
+ - type: acc_norm
42
+ value: 50.38
43
+ name: normalized accuracy
44
+ source:
45
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
46
+ name: Open LLM Leaderboard
47
+ - task:
48
+ type: text-generation
49
+ name: Text Generation
50
+ dataset:
51
+ name: MATH Lvl 5 (4-Shot)
52
+ type: hendrycks/competition_math
53
+ args:
54
+ num_few_shot: 4
55
+ metrics:
56
+ - type: exact_match
57
+ value: 55.74
58
+ name: exact match
59
+ source:
60
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
61
+ name: Open LLM Leaderboard
62
+ - task:
63
+ type: text-generation
64
+ name: Text Generation
65
+ dataset:
66
+ name: GPQA (0-shot)
67
+ type: Idavidrein/gpqa
68
+ args:
69
+ num_few_shot: 0
70
+ metrics:
71
+ - type: acc_norm
72
+ value: 11.86
73
+ name: acc_norm
74
+ source:
75
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
76
+ name: Open LLM Leaderboard
77
+ - task:
78
+ type: text-generation
79
+ name: Text Generation
80
+ dataset:
81
+ name: MuSR (0-shot)
82
+ type: TAUR-Lab/MuSR
83
+ args:
84
+ num_few_shot: 0
85
+ metrics:
86
+ - type: acc_norm
87
+ value: 16.35
88
+ name: acc_norm
89
+ source:
90
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
91
+ name: Open LLM Leaderboard
92
+ - task:
93
+ type: text-generation
94
+ name: Text Generation
95
+ dataset:
96
+ name: MMLU-PRO (5-shot)
97
+ type: TIGER-Lab/MMLU-Pro
98
+ config: main
99
+ split: test
100
+ args:
101
+ num_few_shot: 5
102
+ metrics:
103
+ - type: acc
104
+ value: 46.3
105
+ name: accuracy
106
+ source:
107
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
108
+ name: Open LLM Leaderboard
109
  ---
110
  # merge
111
 
 
146
  dtype: bfloat16
147
 
148
  ```
149
+
150
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
151
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/wanlige__li-14b-v0.4-details)
152
+
153
+ | Metric |Value|
154
+ |-------------------|----:|
155
+ |Avg. |43.66|
156
+ |IFEval (0-Shot) |81.33|
157
+ |BBH (3-Shot) |50.38|
158
+ |MATH Lvl 5 (4-Shot)|55.74|
159
+ |GPQA (0-shot) |11.86|
160
+ |MuSR (0-shot) |16.35|
161
+ |MMLU-PRO (5-shot) |46.30|
162
+