Hugging Face's logo

oneonlee
/
KoSOLAR-v0.2-gugutypus-10.7B

Text Generation
Transformers
Safetensors
English
Korean
llama
text-generation-inference
Inference Endpoints
Model card Files Community
oneonlee commited on
Commit
56841d5
·
verified ·
1 Parent(s): 2e7b09f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -69,17 +69,17 @@ pipeline_tag: text-generation
69
  | Tasks |Version|Filter|n-shot|Metric|Value | |Stderr|
70
  |------------------|-------|------|-----:|------|-----:|---|-----:|
71
  |MMLU |N/A |none | 0|acc |0.5826|± |0.1432|
72
- |MMLU |N/A |none | 5|acc | |± | |
73
  |HellaSwag | 1|none | 0|acc |0.6075|± |0.0049|
74
- |HellaSwag | 1|none | 5|acc | |± | |
75
  |BoolQ | 2|none | 0|acc |0.8737|± |0.0058|
76
- |BoolQ | 2|none | 5|acc | |± | |
77
  |COPA | 1|none | 0|acc |0.8300|± |0.0378|
78
- |COPA | 1|none | 5|acc | |± | |
79
  |truthfulqa |N/A |none | 0|acc |0.4249|± |0.0023|
80
  |truthfulqa |N/A |none | 5|acc | |± | |
81
 
82
-
83
  ---
84
 
85
 
 
69
  | Tasks |Version|Filter|n-shot|Metric|Value | |Stderr|
70
  |------------------|-------|------|-----:|------|-----:|---|-----:|
71
  |MMLU |N/A |none | 0|acc |0.5826|± |0.1432|
72
+ |MMLU |N/A |none | 5|acc |0.5885|± |0.1285|
73
  |HellaSwag | 1|none | 0|acc |0.6075|± |0.0049|
74
+ |HellaSwag | 1|none | 5|acc |0.6098|± |0.0049|
75
  |BoolQ | 2|none | 0|acc |0.8737|± |0.0058|
76
+ |BoolQ | 2|none | 5|acc |0.8826|± |0.0056|
77
  |COPA | 1|none | 0|acc |0.8300|± |0.0378|
78
+ |COPA | 1|none | 5|acc |0.9100|± |0.0288|
79
  |truthfulqa |N/A |none | 0|acc |0.4249|± |0.0023|
80
  |truthfulqa |N/A |none | 5|acc | |± | |
81
 
82
+
83
  ---
84
 
85