Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,7 @@ license: apache-2.0
|
|
11 |
</div>
|
12 |
|
13 |
|
14 |
-
<img src="https://i.imgur.com/e1LEQ18.png" alt="
|
15 |
|
16 |
|
17 |
# Model Details
|
@@ -21,6 +21,59 @@ Zion_Alpha is the first **REAL** Hebrew model in the world. It wasn't finetuned
|
|
21 |
# Model architecture
|
22 |
Based on Mistral 7B. I didn't even bother to alter the tokenizer.
|
23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
### Support
|
25 |
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">
|
26 |
|
|
|
11 |
</div>
|
12 |
|
13 |
|
14 |
+
<img src="https://i.imgur.com/e1LEQ18.png" alt="Zion_Alpha" style="width: 50%; min-width: 400px; display: block; margin: auto;">
|
15 |
|
16 |
|
17 |
# Model Details
|
|
|
21 |
# Model architecture
|
22 |
Based on Mistral 7B. I didn't even bother to alter the tokenizer.
|
23 |
|
24 |
+
# The recommended prompt setting is Debug-deterministic:
|
25 |
+
```
|
26 |
+
temperature: 1
|
27 |
+
top_p: 1
|
28 |
+
top_k: 1
|
29 |
+
typical_p: 1
|
30 |
+
min_p: 1
|
31 |
+
repetition_penalty: 1
|
32 |
+
```
|
33 |
+
|
34 |
+
# The recommended instruction template is Mistral:
|
35 |
+
```
|
36 |
+
{%- for message in messages %}
|
37 |
+
{%- if message['role'] == 'system' -%}
|
38 |
+
{{- message['content'] -}}
|
39 |
+
{%- else -%}
|
40 |
+
{%- if message['role'] == 'user' -%}
|
41 |
+
{{-'[INST] ' + message['content'].rstrip() + ' [/INST]'-}}
|
42 |
+
{%- else -%}
|
43 |
+
{{-'' + message['content'] + '</s>' -}}
|
44 |
+
{%- endif -%}
|
45 |
+
{%- endif -%}
|
46 |
+
{%- endfor -%}
|
47 |
+
{%- if add_generation_prompt -%}
|
48 |
+
{{-''-}}
|
49 |
+
{%- endif -%}
|
50 |
+
```
|
51 |
+
# English to hebrew example:
|
52 |
+
|
53 |
+
|
54 |
+
<div align="center">
|
55 |
+
<b style="font-size: 40px;">Zion_Alpha English to Hebrew example</b>
|
56 |
+
|
57 |
+
|
58 |
+
</div>
|
59 |
+
|
60 |
+
|
61 |
+
<img src="https://i.imgur.com/JnTuawF.png" alt="Zion_Alpha" style="width: 50%; min-width: 400px; display: block; margin: auto;">
|
62 |
+
|
63 |
+
|
64 |
+
# English to hebrew example:
|
65 |
+
|
66 |
+
|
67 |
+
<div align="center">
|
68 |
+
<b style="font-size: 40px;">Zion_Alpha Hebrew to English example</b>
|
69 |
+
|
70 |
+
|
71 |
+
</div>
|
72 |
+
|
73 |
+
|
74 |
+
<img src="https://i.imgur.com/Wm2igLJ.png" alt="Zion_Alpha" style="width: 50%; min-width: 400px; display: block; margin: auto;">
|
75 |
+
|
76 |
+
|
77 |
### Support
|
78 |
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">
|
79 |
|