mihaimasala commited on
Commit
abf741f
·
verified ·
1 Parent(s): 518f456

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -32,7 +32,7 @@ OpenLLM represents the first open-source effort to build a LLM specialized for R
32
  <!-- Provide the basic links for the model. -->
33
 
34
  - **Repository:** https://github.com/OpenLLM-Ro/llama-recipes
35
- - **Paper:** https://arxiv.org/abs/2405.07703
36
 
37
  ## Intended Use
38
 
@@ -74,19 +74,19 @@ print(tokenizer.decode(outputs[0]))
74
 
75
  | Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
76
  |--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
77
- | Llama-2-7b | 35.65 | 33.85 | 30.93 | 56.43 | 46.98 | 1.37 | 44.36 |
78
- | RoLlama2-7b-Base | 38.32 | 35.83 | 30.47 | 60.16 | 55.52 | 2.17 | 45.78 |
79
- | Llama-2-7b-chat | 35.58 | 34.92 | 32.37 | 54.26 | 44.52 | 2.05 | 45.38 |
80
- |*RoLlama2-7b-Instruct*|***44.42***|***40.36***|***37.41***|***69.58*** | *55.64* |***17.59***| *45.96* |
81
- |RoLlama2-7b-Chat | 42.65 | 38.29 | 35.27 | 65.25 | **56.45**| 12.84 | **47.79**|
82
 
83
  ## MT-Bench
84
 
85
  | Model | Average | 1st turn | 2nd turn |
86
  |--------------------|:--------:|:--------:|:--------:|
87
- | Llama-2-7b-chat | 1.70 | 2.00 | 1.41 |
88
- |*RoLlama2-7b-Instruct*| ***4.31***|***5.66***| *2.95* |
89
- |RoLlama2-7b-Chat | 3.91 | 4.25 | **3.57** |
90
 
91
 
92
 
 
32
  <!-- Provide the basic links for the model. -->
33
 
34
  - **Repository:** https://github.com/OpenLLM-Ro/llama-recipes
35
+ - **Paper:** https://arxiv.org/abs/2406.18266
36
 
37
  ## Intended Use
38
 
 
74
 
75
  | Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
76
  |--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
77
+ | Llama-2-7b-chat | 38.03 | 37.95 | 27.22 | 59.29 | 57.22 | 2.53 | 44.00 |
78
+ |*RoLlama2-7b-Instruct*|***45.71***|***43.66***|***39.70***|***70.34*** | *57.36* |***18.78***| *44.44* |
79
+ |RoLlama2-7b-Chat | 43.82 | 41.92 | 37.29 | 66.68 | **57.91**| 13.47 | **45.65 **|
80
+
81
+
82
 
83
  ## MT-Bench
84
 
85
  | Model | Average | 1st turn | 2nd turn |
86
  |--------------------|:--------:|:--------:|:--------:|
87
+ | Llama-2-7b-chat | 1.21 | 1.68 | 0.74 |
88
+ |*RoLlama2-7b-Instruct*| ***3.70***|***4.74***| *2.66* |
89
+ |RoLlama2-7b-Chat | TBC | TBC | TBC |
90
 
91
 
92