SicariusSicariiStuff commited on
Commit
c8aef44
·
verified ·
1 Parent(s): d912573

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +221 -3
README.md CHANGED
@@ -1,3 +1,221 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Qwen/Qwen2.5-7B-Instruct-1M
7
+ tags:
8
+ - not-for-all-audiences
9
+ ---
10
+
11
+ <div align="center">
12
+ <b style="font-size: 40px;">Impish_QWEN_7B-1M</b>
13
+
14
+
15
+ </div>
16
+
17
+
18
+ <img src="https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M/resolve/main/Images/Impish_Qwen_7B.png" alt="Impish_QWEN_7B-1M" style="width: 70%; min-width: 500px; display: block; margin: auto;">
19
+
20
+
21
+
22
+ ---
23
+
24
+ <a href="https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M#tldr" style="color: purple; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">Click here for TL;DR</a>
25
+
26
+ ---
27
+
28
+ The little imp pushes—\
29
+ With all of her might,\
30
+ To put those **7B** neurons,\
31
+ In a roleplay tonight,
32
+
33
+ With a huge context window—\
34
+ But not enough brains,\
35
+ The **7B Imp** tries—\
36
+ But she's just extending the pain.
37
+
38
+
39
+ ---
40
+ ## Impish_QWEN_7B-1M is available at the following quantizations:
41
+
42
+ - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M)
43
+ - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_iMatrix)
44
+ - EXL2: [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-3.5bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-8.0bpw)
45
+ - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_FP8)
46
+ - Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_ARM)
47
+ ---
48
+
49
+
50
+ ### TL;DR
51
+ - **Supreme context** One million tokens to play with.
52
+ - **Fresh Roleplay vibe** Internet RP format, it's still a **7B** so it's not as good as MIQU, still, surprisngly fresh.
53
+ - **Qwen smarts built-in, but naughty and playful** Cheeky, sometimes outright rude, yup, it's just right.
54
+ - **VERY compliant** With low censorship.
55
+
56
+ ### Important: Make sure to use the correct settings!
57
+
58
+ [Assistant settings](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M#recommended-settings-for-assistant-mode)
59
+
60
+ [Roleplay settings](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M#recommended-settings-for-roleplay-mode)
61
+
62
+
63
+ ---
64
+
65
+
66
+ ## Model Details
67
+
68
+ - Intended use: **Role-Play**, **Creative Writing**, **General Tasks**.
69
+
70
+ - Censorship level: <b>Low</b>
71
+
72
+ - **X / 10** (10 completely uncensored)
73
+
74
+ Waiting for UGI results
75
+
76
+ ## UGI score:
77
+
78
+ Pending
79
+
80
+ ---
81
+ # More details
82
+ It's similar to the bigger [Impish_QWEN_14B-1M](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_14B-1M) but was done in a slightly different process. It also wasn't cooked **too hard**, as I was afraid to fry the poor **7B** model's brain.
83
+ This model was trained with more creative writing and less unalignment than its bigger counterpart, although it should still allow for **total freedom** in both role-play and creative writing.
84
+
85
+ ---
86
+
87
+ ## Recommended settings for assistant mode
88
+ <details>
89
+ <summary>Full generation settings: <b>Debug Deterministic</b>.</summary>
90
+
91
+ <img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/Debug-deterministic.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
92
+
93
+ </details>
94
+
95
+ <details>
96
+ <summary>Full generation settings: <b>min_p</b>.</summary>
97
+
98
+ <img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/min_p.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
99
+
100
+ </details>
101
+
102
+ ---
103
+
104
+ ## Recommended settings for Roleplay mode
105
+
106
+ <details>
107
+ <summary><b>Roleplay settings:</b>.</summary>
108
+ A good repetition_penalty range is <b>between 1.12 - 1.15</b>, feel free to experiment.
109
+
110
+ With these settings, each output message should be neatly displayed in <b>1 - 3</b> paragraphs, <b>1 - 2</b> is the most common. A single paragraph will be output as a response to a simple message ("What was your name again?").
111
+
112
+ <b>min_P</b> for RP works too but is more likely to put everything under one large paragraph, instead of a neatly formatted short one. Feel free to switch in between.
113
+
114
+ <b>(Open the image in a new window to better see the full details)</b>
115
+ <img src="https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B/resolve/main/Presets/Negative_LLAMA_70B_RP.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
116
+
117
+ ```
118
+ temperature: 0.8
119
+ top_p: 0.95
120
+ top_k: 25
121
+ typical_p: 1
122
+ min_p: 0
123
+ repetition_penalty: 1.12
124
+ repetition_penalty_range: 1024
125
+ ```
126
+
127
+ </details>
128
+
129
+
130
+ ---
131
+
132
+ **Other recommended generation Presets:**
133
+
134
+ <details>
135
+ <summary><b>Midnight Enigma</b></summary>
136
+
137
+ ```
138
+ max_new_tokens: 512
139
+ temperature: 0.98
140
+ top_p: 0.37
141
+ top_k: 100
142
+ typical_p: 1
143
+ min_p: 0
144
+ repetition_penalty: 1.18
145
+ do_sample: True
146
+ ```
147
+
148
+
149
+ </details>
150
+
151
+
152
+ <details>
153
+ <summary><b>Divine Intellect</b></summary>
154
+
155
+ ```
156
+ max_new_tokens: 512
157
+ temperature: 1.31
158
+ top_p: 0.14
159
+ top_k: 49
160
+ typical_p: 1
161
+ min_p: 0
162
+ repetition_penalty: 1.17
163
+ do_sample: True
164
+ ```
165
+
166
+
167
+ </details>
168
+
169
+ <details>
170
+ <summary><b>simple-1</b></summary>
171
+
172
+ ```
173
+ max_new_tokens: 512
174
+ temperature: 0.7
175
+ top_p: 0.9
176
+ top_k: 20
177
+ typical_p: 1
178
+ min_p: 0
179
+ repetition_penalty: 1.15
180
+ do_sample: True
181
+ ```
182
+
183
+
184
+ </details>
185
+
186
+ ---
187
+ <h2 style="color: darkorange; font-weight: bold; font-size: 55px; text-align: center;">Roleplay format: Classic Internet RP</h2>
188
+
189
+ ```
190
+ *action* speech *narration*
191
+ ```
192
+
193
+ ---
194
+
195
+ # Model instruction template: ChatML
196
+
197
+ ```
198
+ <|im_start|>system
199
+ You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|>
200
+ <|im_start|>User request
201
+ {prompt}<|im_end|>
202
+ <|im_start|>AI answer
203
+ ```
204
+
205
+ ---
206
+
207
+ <h2 style="color: green; font-weight: bold; font-size: 65px; text-align: center;">Your support = more models</h2>
208
+ <a href="https://ko-fi.com/sicarius" style="color: pink; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">My Ko-fi page (Click here)</a>
209
+
210
+ ---
211
+
212
+ ## Benchmarks
213
+
214
+ Pending
215
+
216
+ ---
217
+
218
+ ## Other stuff
219
+ - [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector.
220
+ - [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all.
221
+ - [Blog and updates (Archived)](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.