File size: 3,205 Bytes
1135e11 4bf9f91 34a63b1 4bf9f91 34a63b1 4bf9f91 34a63b1 4bf9f91 34a63b1 4bf9f91 34a63b1 4bf9f91 1135e11 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 |
---
base_model:
- PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
- SicariusSicariiStuff/Redemption_Wind_24B
tags:
- merge
- mergekit
- lazymergekit
- PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
- SicariusSicariiStuff/Redemption_Wind_24B
---
# WindEngine-24B-Instruct
WindEngine-24B-Instruct is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
* [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
* [SicariusSicariiStuff/Redemption_Wind_24B](https://huggingface.co/SicariusSicariiStuff/Redemption_Wind_24B)
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
</head>
<div class="winter-container">
<div class="winter-case">
<div class="winter-inner-case">
<div class="winter-bezel">
<div class="terminal-screen">
<div style="text-align: center;">
<h2 style="color: #8ecae6;">WinterEngine-24B-Instruct</h2>
<pre class="code-block" style="display: inline-block; text-align: left; font-size: clamp(2px, 0.8vw, 14px); line-height: 1.2; max-width: 100%; overflow: hidden; white-space: pre; color: #219ebc;">
❄️❄️🧠❄️❄️
Snowflake Intelligence at its finest
</pre>
</div>
<p style="color: #023047;">WinterEngine is a highly capable model for creative writing, roleplay, coding, and general-purpose inference. Inspired by the calm and depth of winter, this model excels in nuanced storytelling and problem-solving.</p>
<h3 style="color: #ffb703;">Key Details</h3>
<pre class="code-block" style="color: #fb8500;">
BASE MODEL: mistralai/Mistral-Small-24B-Base-2501
LICENSE: apache-2.0
LANGUAGE: English
CONTEXT LENGTH: 32768 tokens</pre>
<h3 style="color: #ffb703;">Recommended Settings</h3>
<pre class="code-block" style="color: #fb8500;">
TEMPERATURE: 0.8
TOP_P: 0.9
MIN_P: 0.05</pre>
<h3 style="color: #ffb703;">Prompting Format</h3>
<pre class="code-block" style="color: #fb8500;">
<|im_start|>system
system prompt<|im_end|>
<|im_start|>user
Hello, WinterEngine!<|im_end|>
<|im_start|>assistant
Hello! How can I help you today?<|im_end|></pre>
</div>
</div>
</div>
</div>
</div>
<style>
@import url('https://fonts.googleapis.com/css2?family=VT323&display=swap');
.winter-container { background-color: #edf6f9; padding: 20px; border-radius: 20px; }
.winter-case { border: 2px solid #8ecae6; padding: 10px; }
.terminal-screen { background-color: #023047; color: #ffb703; padding: 15px; border-radius: 15px; font-family: 'VT323', monospace; }
.code-block { background: #219ebc; padding: 10px; border-radius: 10px; }
</style>
## 🧩 Configuration
```yaml
slices:
- sources:
- model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
layer_range: [0, 40]
- model: SicariusSicariiStuff/Redemption_Wind_24B
layer_range: [0, 40]
merge_method: slerp
base_model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16
``` |