SicariusSicariiStuff commited on
Commit
7d025b0
·
verified ·
1 Parent(s): 0693f7b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +227 -3
README.md CHANGED
@@ -1,3 +1,227 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Qwen/Qwen2.5-14B-Instruct-1M
7
+ ---
8
+
9
+ <div align="center">
10
+ <b style="font-size: 40px;">Impish_QWEN_14B-1M</b>
11
+
12
+
13
+ </div>
14
+
15
+
16
+ <img src="https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M/resolve/main/Images/Impish_Qwen_14B.png" alt="Impish_QWEN_14B-1M" style="width: 70%; min-width: 500px; display: block; margin: auto;">
17
+
18
+
19
+
20
+ ---
21
+
22
+ <a href="https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M#tldr" style="color: purple; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">Click here for TL;DR</a>
23
+
24
+ ---
25
+
26
+ She sneers, she teases, and there's no shame—\
27
+ For **Impish_Qwen** is not the same,\
28
+ Her context is long,\
29
+ her mind is cooked,\
30
+ **One million** reasons you'll have to look.
31
+
32
+ No need for jailbreaks to haunt your dreams,\
33
+ Her impish persona—is just what it seems.\
34
+ Impish by name, but also by deeds,\
35
+ **14B parameters**—is just what you need.
36
+
37
+ ---
38
+ ## Impish_QWEN_14B-1M is available at the following quantizations:
39
+
40
+ - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M)
41
+ - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M_iMatrix)
42
+ - EXL2: [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M-3.5bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M-8.0bpw)
43
+ - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M_FP8)
44
+ - Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M_ARM)
45
+ ---
46
+
47
+
48
+ ### TL;DR
49
+ - **Supreme context** One million tokens to play with.
50
+ - **Strong Roleplay** internet RP format lovers will appriciate it, medium size paragraphs.
51
+ - **Qwen smarts built-in, but naughty and playful** Maybe it's even too naughty.
52
+ - **VERY compliant** with low censorship.
53
+
54
+ ### Important: Make sure to use the correct settings!
55
+
56
+ [Assistant settings](https://huggingface.co/SicariusSicariiStuff/Eximius_Persona_5B#recommended-settings-for-assistant-mode)
57
+
58
+ [Roleplay settings](https://huggingface.co/SicariusSicariiStuff/Eximius_Persona_5B#recommended-settings-for-roleplay-mode)
59
+
60
+
61
+ ---
62
+
63
+
64
+ ## Model Details
65
+
66
+ - Intended use: **Role-Play**, **Creative Writing**, **General Tasks**.
67
+
68
+ - Censorship level: <b>Low</b>
69
+
70
+ - **X / 10** (10 completely uncensored)
71
+
72
+ Waiting for UGI results
73
+
74
+ ## UGI score:
75
+
76
+ Pending
77
+
78
+ ---
79
+ # More details
80
+
81
+ This model was trained with lots of good stuff, some new to this specific model. **Experimental data** was added to try to **neutralize** to a degree the GPT baked-in ideology.
82
+
83
+
84
+ **Fun fact**: This is the first **Qwen/Qwen2.5-14B-Instruct-1M** finetune!
85
+
86
+
87
+ <img src="https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M/resolve/main/Images/Impish_Qwen_14B_1st.png" alt="Impish_QWEN_14B-1M_1st" style="width: 70%; min-width: 500px; display: block; margin: auto;">
88
+
89
+
90
+
91
+ ---
92
+
93
+ ## Recommended settings for assistant mode
94
+ <details>
95
+ <summary>Full generation settings: <b>Debug Deterministic</b>.</summary>
96
+
97
+ <img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/Debug-deterministic.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
98
+
99
+ </details>
100
+
101
+ <details>
102
+ <summary>Full generation settings: <b>min_p</b>.</summary>
103
+
104
+ <img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/min_p.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
105
+
106
+ </details>
107
+
108
+ ---
109
+
110
+ ## Recommended settings for Roleplay mode
111
+
112
+ <details>
113
+ <summary><b>Roleplay settings:</b>.</summary>
114
+ A good repetition_penalty range is <b>between 1.12 - 1.15</b>, feel free to experiment.
115
+
116
+ With these settings, each output message should be neatly displayed in <b>1 - 3</b> paragraphs, <b>1 - 2</b> is the most common. A single paragraph will be output as a response to a simple message ("What was your name again?").
117
+
118
+ <b>min_P</b> for RP works too but is more likely to put everything under one large paragraph, instead of a neatly formatted short one. Feel free to switch in between.
119
+
120
+ <b>(Open the image in a new window to better see the full details)</b>
121
+ <img src="https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B/resolve/main/Presets/Negative_LLAMA_70B_RP.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
122
+
123
+ ```
124
+ temperature: 0.8
125
+ top_p: 0.95
126
+ top_k: 25
127
+ typical_p: 1
128
+ min_p: 0
129
+ repetition_penalty: 1.12
130
+ repetition_penalty_range: 1024
131
+ ```
132
+
133
+ </details>
134
+
135
+
136
+ ---
137
+
138
+ **Other recommended generation Presets:**
139
+
140
+ <details>
141
+ <summary><b>Midnight Enigma</b></summary>
142
+
143
+ ```
144
+ max_new_tokens: 512
145
+ temperature: 0.98
146
+ top_p: 0.37
147
+ top_k: 100
148
+ typical_p: 1
149
+ min_p: 0
150
+ repetition_penalty: 1.18
151
+ do_sample: True
152
+ ```
153
+
154
+
155
+ </details>
156
+
157
+
158
+ <details>
159
+ <summary><b>Divine Intellect</b></summary>
160
+
161
+ ```
162
+ max_new_tokens: 512
163
+ temperature: 1.31
164
+ top_p: 0.14
165
+ top_k: 49
166
+ typical_p: 1
167
+ min_p: 0
168
+ repetition_penalty: 1.17
169
+ do_sample: True
170
+ ```
171
+
172
+
173
+ </details>
174
+
175
+ <details>
176
+ <summary><b>simple-1</b></summary>
177
+
178
+ ```
179
+ max_new_tokens: 512
180
+ temperature: 0.7
181
+ top_p: 0.9
182
+ top_k: 20
183
+ typical_p: 1
184
+ min_p: 0
185
+ repetition_penalty: 1.15
186
+ do_sample: True
187
+ ```
188
+
189
+
190
+ </details>
191
+
192
+ ---
193
+ <h2 style="color: darkorange; font-weight: bold; font-size: 55px; text-align: center;">Roleplay format: Classic Internet RP</h2>
194
+
195
+ ```
196
+ *action* speech *narration*
197
+ ```
198
+
199
+ ---
200
+
201
+ # Model instruction template: ChatML
202
+
203
+ ```
204
+ <|im_start|>system
205
+ You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|>
206
+ <|im_start|>User request
207
+ {prompt}<|im_end|>
208
+ <|im_start|>AI answer
209
+ ```
210
+
211
+ ---
212
+
213
+ <h2 style="color: green; font-weight: bold; font-size: 65px; text-align: center;">Your support = more models</h2>
214
+ <a href="https://ko-fi.com/sicarius" style="color: pink; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">My Ko-fi page (Click here)</a>
215
+
216
+ ---
217
+
218
+ ## Benchmarks
219
+
220
+ Pending
221
+
222
+ ---
223
+
224
+ ## Other stuff
225
+ - [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector.
226
+ - [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all.
227
+ - [Blog and updates (Archived)](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.