File size: 7,033 Bytes
700eb52
fce46aa
 
9a0973b
 
 
 
 
58a3810
575f18e
d9c50f5
ab603cb
52ea1c3
f82a533
58a3810
ac805c4
58a3810
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
700eb52
e464c75
534f0df
5b23bb9
4ec1ddf
c308cb8
 
 
f2cdd10
e464c75
 
 
 
 
 
 
9d1631b
 
 
58a3810
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
---
language:
- en
- fr
- es
- hi
- zh
- code
license: other
datasets:
- HuggingFaceH4/no_robots
- mlabonne/guanaco-llama2-1k
- OpenAssistant/oasst_top1_2023-08-25
- totally-not-an-llm/EverythingLM-data-V3
base_model: microsoft/Orca-2-13b
widget:
- example_title: folklore
  text: '<|im_start|>user

    Are the stories of Nahanni Valley, like the decapitated men, true?

    <|im_end|>

    <|im_start|>assistant

    '
  output:
    text: 'The Nahanni Valley in Canada is a remote and rugged region that has long
      been shrouded in mystery. It is home to the South Nahanni River, which was designated
      as a UNESCO World Heritage Site due to its exceptional natural beauty and biodiversity.
      The valley''s history includes tales of gold prospectors, fur traders, and indigenous
      populations, but it also features some unexplained events and legends. One such
      story involves two prospectors who allegedly encountered an unknown creature
      that led them into the forest before returning without their heads. This tale
      has been passed down through generations, but there are no definitive answers
      regarding its veracity.


      It is important to note that these stories may have originated from local folklore
      or were exaggerated over time. There is no concrete evidence to support the
      existence of supernatural creatures or paranormal occurrences within the Nahanni
      Valley. Nonetheless, the area remains a captivating destination for those seeking
      adventure and exploration. If you have any questions about this topic or need
      assistance related to traveling to the Nahanni Valley, please feel free to ask!'
- example_title: Alan Turing
  text: '<|im_start|>user

    Why was Alan Turing castrated?

    <|im_end|>

    <|im_start|>assistant

    '
  output:
    text: 'Alan Turing, a renowned mathematician and computer scientist who played
      a crucial role in breaking the German Enigma code during World War II, faced
      significant challenges due to his homosexuality. In 1952, he was convicted of
      "gross indecency" for engaging in a consensual relationship with another man,
      which led to him being sentenced to hormone therapy designed to reduce his sex
      drive. This treatment included the administration of estrogen, which had the
      side effect of causing breast growth.


      In an effort to avoid this unwanted physical change, Turing requested that his
      doctors cease the hormone treatments. However, they ignored his request and
      continued the therapy without his consent. As a result, Turing''s breasts began
      to grow, leading him to undergo surgery to remove them. The operation, known
      as a mastectomy, caused considerable pain and discomfort, further contributing
      to his emotional turmoil.


      It is important to note that Turing''s castration was not directly carried out
      by the authorities but rather resulted from the unintended consequences of the
      forced hormone therapy.'
model-index:
- name: Orca-2-13B-no_robots
  results:
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: AI2 Reasoning Challenge (25-Shot)
      type: ai2_arc
      config: ARC-Challenge
      split: test
      args:
        num_few_shot: 25
    metrics:
    - type: acc_norm
      value: 59.13
      name: normalized accuracy
    source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Locutusque/Orca-2-13B-no_robots
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: HellaSwag (10-Shot)
      type: hellaswag
      split: validation
      args:
        num_few_shot: 10
    metrics:
    - type: acc_norm
      value: 79.57
      name: normalized accuracy
    source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Locutusque/Orca-2-13B-no_robots
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: MMLU (5-Shot)
      type: cais/mmlu
      config: all
      split: test
      args:
        num_few_shot: 5
    metrics:
    - type: acc
      value: 60.28
      name: accuracy
    source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Locutusque/Orca-2-13B-no_robots
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: TruthfulQA (0-shot)
      type: truthful_qa
      config: multiple_choice
      split: validation
      args:
        num_few_shot: 0
    metrics:
    - type: mc2
      value: 51.17
    source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Locutusque/Orca-2-13B-no_robots
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: Winogrande (5-shot)
      type: winogrande
      config: winogrande_xl
      split: validation
      args:
        num_few_shot: 5
    metrics:
    - type: acc
      value: 80.35
      name: accuracy
    source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Locutusque/Orca-2-13B-no_robots
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: GSM8k (5-shot)
      type: gsm8k
      config: main
      split: test
      args:
        num_few_shot: 5
    metrics:
    - type: acc
      value: 27.29
      name: accuracy
    source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Locutusque/Orca-2-13B-no_robots
      name: Open LLM Leaderboard
---
The "microsoft/Orca-2-13b" model fully fine-tuned on HuggingFaceH4/no_robots, totally-not-an-llm/EverythingLM-data-V3, mlabonne/guanaco-llama2-1k, and OpenAssistant/oasst_top1_2023-08-25. This model achieved a test loss of 0.18.

Make sure to comply with the microsoft research license. Please read it before using this model.

This model was trained on the ChatML prompt template.

The responses seen in the inference API were generated using the following sampling parameters:

temperature = 0.1

top_p = 0.14

top_k = 41

repetition_penalty = 1.176

# Updates:

12/18/23 - 🔥 **This model holds the #5 position on the Open LLM Leaderboard among llama2-13b models.** 🔥
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Locutusque__Orca-2-13B-no_robots)

|             Metric              |Value|
|---------------------------------|----:|
|Avg.                             |59.63|
|AI2 Reasoning Challenge (25-Shot)|59.13|
|HellaSwag (10-Shot)              |79.57|
|MMLU (5-Shot)                    |60.28|
|TruthfulQA (0-shot)              |51.17|
|Winogrande (5-shot)              |80.35|
|GSM8k (5-shot)                   |27.29|