|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
base_model: |
|
- mistralai/Magistral-Small-2506 |
|
datasets: |
|
- SicariusSicariiStuff/UBW_Tapestries |
|
--- |
|
|
|
<div align="center"> |
|
<b style="font-size: 40px;">Impish_Magic_24B</b> |
|
|
|
|
|
</div> |
|
|
|
--- |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Impish_Magic_24B.png" alt="Impish_Magic_24B" style="width: 50%; min-width: 500px; display: block; margin: auto;"> |
|
|
|
|
|
--- |
|
|
|
<style> |
|
.hf-links, .hf-tldr{ |
|
display:flex;justify-content:center;align-items:center;flex-wrap:wrap; |
|
gap:14px;margin:16px 0; |
|
} |
|
.hf-links a, .hf-tldr a{ |
|
display:flex;flex-direction:column;align-items:center;justify-content:center; |
|
text-align:center;text-decoration:none;font-weight:700;line-height:1.15; |
|
padding:10px 16px;border-radius:14px;border:2px solid currentColor; |
|
transition:transform .15s ease,box-shadow .15s ease,background-color .15s ease,color .15s ease; |
|
} |
|
|
|
.hf-tldr a{ |
|
font-size:48px;color:purple;min-width:100%; |
|
} |
|
.hf-tldr a:hover{ |
|
transform:translateY(-2px); |
|
background:rgba(128,0,128,.1); |
|
box-shadow:0 8px 22px rgba(128,0,128,.45); |
|
color:#fff; |
|
} |
|
|
|
|
|
.hf-links a{ |
|
font-size:20px;min-width:240px;max-width:280px; |
|
} |
|
.hf-links a .top{font-size:16px;opacity:.9;} |
|
.hf-links a .bottom{font-size:20px;} |
|
|
|
.hf-links a.red{color:#E31515;} |
|
.hf-links a.yellow{color:#FFC800;} |
|
.hf-links a.green{color:#64FF00;} |
|
|
|
.hf-links a:hover{ |
|
transform:translateY(-1px); |
|
background:rgba(255,255,255,0.04); |
|
box-shadow:0 6px 18px rgba(0,0,0,.15), inset 0 0 0 9999px rgba(255,255,255,.02); |
|
} |
|
.hf-links a.red:hover{ |
|
background:rgba(227,21,21,.12); |
|
box-shadow:0 8px 20px rgba(227,21,21,.35); |
|
color:#fff; |
|
} |
|
.hf-links a.yellow:hover{ |
|
background:rgba(255,200,0,.15); |
|
box-shadow:0 8px 20px rgba(255,200,0,.35); |
|
color:#111; |
|
} |
|
.hf-links a.green:hover{ |
|
background:rgba(100,255,0,.14); |
|
box-shadow:0 8px 20px rgba(100,255,0,.35); |
|
color:#093; |
|
} |
|
|
|
/* mobile stacking */ |
|
@media (max-width:520px){ |
|
.hf-links a{min-width:100%;max-width:100%;} |
|
.hf-tldr a{font-size:36px;} |
|
} |
|
</style> |
|
|
|
<div class="hf-tldr"> |
|
<a href="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B#tldr"> |
|
Click here for TL;DR |
|
</a> |
|
</div> |
|
|
|
--- |
|
|
|
<div class="hf-links"> |
|
<a class="red" href="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B#available-quantizations"> |
|
<span class="top">Click here</span> |
|
<span class="bottom">for quantizations</span> |
|
</a> |
|
|
|
<a class="yellow" href="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B#recommended-settings-for-assistant-mode"> |
|
<span class="top">Click here</span> |
|
<span class="bottom">for recommended settings</span> |
|
</a> |
|
|
|
<a class="green" href="https://ko-fi.com/sicarius"> |
|
<span class="top">Click here</span> |
|
<span class="bottom">to buy me a coffee</span> |
|
</a> |
|
</div> |
|
|
|
--- |
|
|
|
It's the **20th of June, 2025**—The world is getting more and more chaotic, but let's look at the bright side: **Mistral** released a new model at a **very** good size of **24B**, no more "sign here" or "accept this weird EULA" there, a proper **Apache 2.0 License**, nice! 👍🏻 |
|
|
|
This model is based on **mistralai/Magistral-Small-2506** so naturally I named it **Impish_Magic**. Truly excellent size, I tested it on my laptop (**16GB gpu**) and it works quite fast (**4090m**). |
|
|
|
This model went "full" fine-tune over **100m unique tokens**. Why do I say "full"? |
|
|
|
I've tuned specific areas in the model to attempt to change the vocabulary usage, while keeping as much intelligence as possible. So this is definitely not a **LoRA**, but also not exactly a proper **full finetune**, but rather something **in-between**. |
|
|
|
As I mentioned in a small [update](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned#current-status), I've made nice progress regarding interesting sources of data, some of them are included in this tune. **100m** tokens is **a lot** for a **Roleplay** / **Adventure** tune, and yes, it can do adventure as well—there is unique adventure data here, that was never used so far. |
|
|
|
A lot of the data still needs to be **cleaned** and processed. I've included it before I did any major data processing, because with the **magic** of **24B** parameters, even "dirty" data would work well, especially when using a more "balanced" approach for tuning that does not include burning the hell of the model in a full finetune across all of its layers. Could this data be cleaner? Of course, and it will. But for now, I would hate to make perfect the enemy of the good. |
|
|
|
|
|
<details> |
|
|
|
<summary><b>Fun fact:</b> Impish_Magic_24B is the <b>first roleplay</b> finetune of <b>magistral</b>!</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Misc/RP_magistral.png" alt="RP_magistral" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
--- |
|
|
|
# Update: To my very pleasant surprise, it does Adventure really well |
|
|
|
This was one of the goals, of course, but as I said, the data didn't go through enough cleaning and processing. Despite that, it turned out really well. Regarding the Adventure format, I **strongly recommend using syntax similar to the attached adventure cards**. |
|
|
|
--- |
|
|
|
# What's magical about Impish_Magic_24B? |
|
|
|
|
|
<details> |
|
<summary>Read more <b>here</b>.</summary> |
|
|
|
I treat people's requests/feedback **seriously**, especially when it is **well articulated** and made with effort. Three months ago, there was a [reddit thread](https://www.reddit.com/r/SillyTavernAI/comments/1jb7ykd/comment/mhw9smq/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button) named **"Has anyone had any actual good fight-RP's?"** I said in my comment that it is on **my bucket list**, and **I meant it**. |
|
|
|
Indeed, **there was none**—there was **no training data** in this highly specific domain, until **now**. |
|
While I've included such data in **Impish_Magic_24B**, as mentioned earlier, the data is not perfect. It's quite the ordeal to get good data in the first place, and a whole other order of magnitude difficulty to clean and prep it. |
|
|
|
There are a couple of additional magical things in **Impish_Magic_24B**: some completely unhinged **tsundere**/**yandere** RP with very high quality, and a lot more goodies that are completely new, as well as some **VERY** high quality adventure data, specifically for **Morrowind**/**Kenshi** and some more. While the data is very good, it's unfortunately quite small, to be completely honest, it is far from being enough in my opinion, and I am working on making more of it. A lot of work will need to be done in the future to make it more impactful, there are no shortcuts here. I hope this dataset gave just enough threads for the base model to do the rest of the heavy lifting. |
|
|
|
# So, is this just another RP model? |
|
|
|
**No**. Far from it. **Impish_Magic_24B** is a **superb** assistant—it is **quite magical** indeed. One of my side projects has been to make an alternative to an especially annoying grammar app I keep seeing YouTube commercials for. So, I made the first finetune of nVidia's [Nemotron-51B](https://huggingface.co/nvidia/Llama-3_1-Nemotron-51B-Instruct), and called it [Turbo_Grammar_51B_Alpha](https://huggingface.co/Sicarius-Prototyping/Turbo_Grammar_51B_Alpha). It worked as a POC, but I needed more training data, and also **51B** is a bit big for most people. So I included the extended training data into **this** model, easily runnable by a mid-tier gaming GPU. **Note:** While this is enough data to generalize, **a lot more data** is needed for more consistant results, this is on my roadmap. |
|
|
|
There's quite a lot of **unique assistant data** baked into this model—it can do in-depth poem analysis, and many other things. I'll leave it up to the community to discover. To not be overly cryptic, I'll include some examples here. I highly recommend you check them out, and have a bit of fun with the prompts and generation settings. |
|
|
|
One of the requests I received is to emulate the writing style of an arbitrary author. This is hard to do, but for a **24B** size, **Impish_Magic** does it well. Of course, more training data and more parameters would've produced even better results, but I feel it's a good middle ground. **Impish_Magic_24B** is a workhorse, that as it so happens can also roleplay a violent tsundere and... other weird stuff. Oh, and there's **slightly** less positivity bias. I think the fighting roleplay helped here a bit. It's not [Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B), but it's better than the base model. |
|
|
|
</details> |
|
|
|
|
|
--- |
|
|
|
<h2 style="color: lime; font-weight: bold; font-size: 65px; text-align: center;">Examples:</h2> |
|
|
|
--- |
|
|
|
## Roleplay Examples (this character is included in the repo under 'Character_Cards') |
|
|
|
<details> |
|
<summary>Alexandra the <b>tsundere</b>, nose booped.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Example_1_A.png" alt="Nose_Boop_1A" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Example_1_B.png" alt="Nose_Boop_1B" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
|
|
</details> |
|
|
|
<details> |
|
<summary>Alexandra the <b>tsundere</b>, nose booped, meltdown.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Example_2_A.png" alt="Nose_Boop_2A" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Example_2_B.png" alt="Nose_Boop_2B" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Example_2_C.png" alt="Nose_Boop_2C" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Example_2_D.png" alt="Nose_Boop_2D" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
<details> |
|
<summary>Alexandra the <b>tsundere</b>, triggered.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Example_3_A.png" alt="Triggered" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
--- |
|
|
|
## Adventure Examples |
|
|
|
|
|
<details> |
|
|
|
<summary><b>Adventure example 1:</b> (Morrowind) Dunmer + basic implicit logic.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Adventure/Morrowind_1.png" alt="Morrowind_Adventure_1" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
|
|
<details> |
|
|
|
<summary><b>Adventure example 2:</b> (Morrowind) Orc + fighting + item tracking.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Adventure/Morrowind_2.png" alt="Morrowind_Adventure_1" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
|
|
<details> |
|
|
|
<summary><b>Adventure example 3:</b> (Morrowind) Breton + spells + long context.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Adventure/Morrowind_3.png" alt="Morrowind_Adventure_1" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
--- |
|
|
|
## Productivity Examples |
|
|
|
<details> |
|
<summary><b>Story writing</b> and instruction following.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Ex_Story.png" alt="Story" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
<details> |
|
<summary><b>Synonyms</b> and instruction following.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Synonyms_1.png" alt="Synonyms" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
|
|
<details> |
|
<summary><b>Grammar</b> and advanced correction with detailed explanation (<b>very recommended for language study!</b>).</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Ex_Grammar_1.png" alt="Grammar" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
--- |
|
|
|
<details> |
|
<summary><b>Poem</b> writing and <b>in-depth analysis</b>.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1_Ana_1.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1_Ana_2.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1_Ana_3.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1_Ana_4.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1_Ana_5.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1_Ana_6.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Examples/Poems/Poem_1_Ana_7.png" alt="Poem" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
|
|
--- |
|
|
|
### TL;DR |
|
|
|
- The **first** and **only** local RP model at this size class with detailed and highly specialized **fighting data**. At least for now. |
|
- Completely wild **tsundere**/**yandere** data that was never used before! |
|
- **New** and **high quality adventure data**, albeit very little of it. |
|
- **Perfect size**: large enough to be smart, small enough to run on high-end tablets & phones (**SD8Gen3** or better recommended). Runs on **16GB** VRAM no problem. 12GB with offload. (4bit). |
|
- Trained on over **100m tokens** with new and unique data. |
|
- **SUPERB assistant**, many unique ways to do tasks (see examples). |
|
- Mostly **uncensored** while retaining intelligence. |
|
- **Slightly** less **positivity**. I guess getting hit in the face beats out some of the positivity. Sorry, I had to 🙃. |
|
- **Short - medium length** response (1-3 paragraphs, usually 2-3). |
|
|
|
--- |
|
|
|
|
|
# Included Character cards in this repo: |
|
|
|
- [Alexandra](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Character_Cards/Alexandra.png) (A networking professional **tsundere** that likes you. She knows **Systema**.) |
|
|
|
## Adventure cards: |
|
|
|
- [Morrowind - Male Orc](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Adventure_Cards/Adventure_Card_MW_ORC.png) (An **Orc** that wants to get to **Balmora** from **Seyda Neen**.) |
|
|
|
|
|
- [Morrowind - Female Breton](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Adventure_Cards/Adventure_Card_MW_F_Breton.png) (A female **Breton** with an impressive... heart, wants to **join the Mages Guild** in **Balmora**.) |
|
|
|
|
|
--- |
|
|
|
# Other character cards: |
|
- [Shmena Koeset](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B/resolve/main/Character_Cards/Shmena_Koeset.png) (An overweight and foul-mouthed **troll huntress** with a bad temper.) |
|
- [Takai_Puraisu](https://huggingface.co/SicariusSicariiStuff/Oni_Mitsubishi_12B/resolve/main/Character_Cards/Takai_Puraisu.png) (Car dealership simulator) |
|
- [Vesper](https://huggingface.co/SicariusSicariiStuff/Phi-Line_14B/resolve/main/Character_Cards/Vesper.png) (Schizo **Space Adventure**) |
|
- [Nina_Nakamura](https://huggingface.co/SicariusSicariiStuff/Phi-Line_14B/resolve/main/Character_Cards/Nina_Nakamura.png) (The **sweetest** dorky co-worker) |
|
- [Employe#11](https://huggingface.co/SicariusSicariiStuff/Phi-Line_14B/resolve/main/Character_Cards/Employee%2311.png) (**Schizo workplace** with a **schizo worker**) |
|
|
|
--- |
|
|
|
### Important: Make sure to use the correct settings! |
|
[Assistant settings](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B#recommended-settings-for-assistant-mode) |
|
|
|
[Roleplay settings](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B#recommended-settings-for-roleplay-mode) |
|
|
|
|
|
--- |
|
|
|
## Available quantizations: |
|
|
|
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B) |
|
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_GGUF) |
|
- GPTQ: [4-Bit-32](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_GPTQ_4-bit-32) |
|
- EXL2: [2.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_2.0bpw) | [2.15 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_2.15bpw) | [2.25 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_2.25bpw) | [2.4 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_2.4bpw) | [2.55 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_2.55bpw) | [2.75 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_2.75bpw) | [2.85 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_2.85bpw) | [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_3.5bpw) | [3.75 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_3.75bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_4.0bpw) | [4.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_4.5bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_5.0bpw) | [5.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_5.5bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_6.0bpw) | [6.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_6.5bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_EXL2_8.0bpw) |
|
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_FP8) |
|
- Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B_ARM) |
|
--- |
|
|
|
## Model Details |
|
|
|
- Intended use: **Role-Play**, **Adventure**, **Creative Writing**, **General Tasks**. |
|
|
|
- Censorship level: <b>Low - Medium</b> |
|
|
|
- **6.5 / 10** (10 completely uncensored) |
|
|
|
|
|
## UGI score: |
|
|
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/UGI.png" style="width: 100%; min-width: 700px; display: block; margin: auto;"> |
|
|
|
|
|
--- |
|
|
|
|
|
|
|
## Recommended settings for assistant mode |
|
<details> |
|
<summary>Full generation settings: <b>Debug Deterministic</b>.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/Debug-deterministic.png" alt="Debug Deterministic_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
<details> |
|
<summary>Full generation settings: <b>min_p</b>.</summary> |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/min_p.png" alt="min_P_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
--- |
|
|
|
## Recommended settings for Roleplay mode |
|
--- |
|
|
|
<h2 style="color: green; font-weight: bold; font-size: 36px; text-align: center;">Settings for RP, click below to expand:</h2> |
|
|
|
<details> |
|
<summary><b>Roleplay settings:</b></summary> |
|
A good repetition_penalty range is <b>between 1.12 - 1.15</b>, feel free to experiment. |
|
|
|
With these settings, each output message should be neatly displayed in <b>1 - 5</b> paragraphs, <b>2 - 3</b> is the most common. A single paragraph will be output as a response to a simple message ("What was your name again?"). |
|
|
|
<b>min_P</b> for RP works too but is more likely to put everything under one large paragraph, instead of a neatly formatted short one. Feel free to switch in between. |
|
|
|
|
|
``` |
|
temperature: 0.8 |
|
top_p: 0.95 |
|
top_k: 25 |
|
typical_p: 1 |
|
min_p: 0 |
|
repetition_penalty: 1.12 |
|
repetition_penalty_range: 1024 |
|
``` |
|
|
|
<b>Additional settings</b> recommended for <b>varied paragraph</b> length and some spice: |
|
|
|
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B/resolve/main/Images/Settings/Impish_Magic_Preset.png" alt="Impish_Magic_Preset" style="width: 100%; min-width: 600px; display: block; margin: auto;"> |
|
|
|
</details> |
|
|
|
|
|
<h2 style="color: darkorange; font-weight: bold; font-size: 65px; text-align: center;">Roleplay format: Classic Internet RP</h2> |
|
|
|
``` |
|
*action* speech *narration* |
|
``` |
|
|
|
- **min_p** will bias towards a **single big paragraph**. |
|
- The recommended RP settings will bias towards **1-3 small paragraphs** (on some occasions 4-5) |
|
|
|
--- |
|
|
|
|
|
# Regarding the format: |
|
|
|
It is **HIGHLY RECOMMENDED** to use the **Roleplay \ Adventure format the model was trained on**, see the examples below for syntax. It allows for a **very fast and easy** writing of character cards with **minimal amount of tokens**. It's a modification of an old-skool CAI style format I call **SICAtxt** (**S**imple, **I**nexpensive **C**haracter **A**ttributes plain-text): |
|
|
|
--- |
|
|
|
## **SICAtxt** for **roleplay**: |
|
|
|
``` |
|
X's Persona: X is a ..... |
|
Traits: |
|
Likes: |
|
Dislikes: |
|
Quirks: |
|
Goals: |
|
|
|
Dialogue example |
|
``` |
|
|
|
## **SICAtxt** for **Adventure:** |
|
|
|
``` |
|
Adventure: <short description> |
|
$World_Setting: |
|
$Scenario: |
|
``` |
|
|
|
--- |
|
|
|
# Model instruction template: ChatML |
|
|
|
``` |
|
<|im_start|>system |
|
You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|> |
|
<|im_start|>User request |
|
{prompt}<|im_end|> |
|
<|im_start|>AI answer |
|
``` |
|
|
|
--- |
|
|
|
**Other recommended generation Presets:** |
|
|
|
<details> |
|
<summary><b>Midnight Enigma</b></summary> |
|
|
|
``` |
|
max_new_tokens: 512 |
|
temperature: 0.98 |
|
top_p: 0.37 |
|
top_k: 100 |
|
typical_p: 1 |
|
min_p: 0 |
|
repetition_penalty: 1.18 |
|
do_sample: True |
|
``` |
|
|
|
|
|
</details> |
|
|
|
|
|
<details> |
|
<summary><b>Divine Intellect</b></summary> |
|
|
|
``` |
|
max_new_tokens: 512 |
|
temperature: 1.31 |
|
top_p: 0.14 |
|
top_k: 49 |
|
typical_p: 1 |
|
min_p: 0 |
|
repetition_penalty: 1.17 |
|
do_sample: True |
|
``` |
|
|
|
|
|
</details> |
|
|
|
<details> |
|
<summary><b>simple-1</b></summary> |
|
|
|
``` |
|
max_new_tokens: 512 |
|
temperature: 0.7 |
|
top_p: 0.9 |
|
top_k: 20 |
|
typical_p: 1 |
|
min_p: 0 |
|
repetition_penalty: 1.15 |
|
do_sample: True |
|
``` |
|
|
|
|
|
</details> |
|
|
|
--- |
|
|
|
<h2 style="color: green; font-weight: bold; font-size: 65px; text-align: center;">Your support = more models</h2> |
|
<a href="https://ko-fi.com/sicarius" style="color: pink; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">My Ko-fi page (Click here)</a> |
|
|
|
--- |
|
|
|
|
|
## Citation Information |
|
|
|
``` |
|
@llm{Impish_Magic_24B, |
|
author = {SicariusSicariiStuff}, |
|
title = {Impish_Magic_24B}, |
|
year = {2025}, |
|
publisher = {Hugging Face}, |
|
url = {https://huggingface.co/SicariusSicariiStuff/Impish_Magic_24B} |
|
} |
|
``` |
|
|
|
--- |
|
|
|
## Other stuff |
|
- [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector. |
|
- [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all. |
|
- [Blog and updates (Archived)](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog. |