|
--- |
|
base_model: |
|
- PocketDoc/Dans-PersonalityEngine-V1.2.0-24b |
|
- SicariusSicariiStuff/Redemption_Wind_24B |
|
tags: |
|
- merge |
|
- mergekit |
|
- lazymergekit |
|
- PocketDoc/Dans-PersonalityEngine-V1.2.0-24b |
|
- SicariusSicariiStuff/Redemption_Wind_24B |
|
--- |
|
|
|
# WindEngine-24B-Instruct |
|
|
|
WindEngine-24B-Instruct is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing): |
|
* [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b) |
|
* [SicariusSicariiStuff/Redemption_Wind_24B](https://huggingface.co/SicariusSicariiStuff/Redemption_Wind_24B) |
|
|
|
|
|
<html lang="en"> |
|
<head> |
|
<meta charset="UTF-8"> |
|
<meta name="viewport" content="width=device-width, initial-scale=1.0"> |
|
<style> |
|
body { |
|
background: linear-gradient(to bottom, #e0f7fa, #ffffff); |
|
font-family: Arial, sans-serif; |
|
color: #004d40; |
|
text-align: center; |
|
padding: 20px; |
|
} |
|
.title { |
|
font-size: 2.5rem; |
|
font-weight: bold; |
|
margin-bottom: 10px; |
|
} |
|
.logo { |
|
width: 100px; |
|
height: 100px; |
|
background: #e0f7fa; |
|
border-radius: 50%; |
|
display: flex; |
|
align-items: center; |
|
justify-content: center; |
|
font-size: 3rem; |
|
color: #004d40; |
|
box-shadow: 0 0 10px #b2ebf2; |
|
} |
|
.description { |
|
font-size: 1.2rem; |
|
margin-top: 20px; |
|
} |
|
.details, .settings, .prompt-format { |
|
text-align: left; |
|
background: #ffffff; |
|
padding: 10px; |
|
margin: 10px auto; |
|
max-width: 600px; |
|
border-radius: 10px; |
|
box-shadow: 0 2px 8px #b2ebf2; |
|
} |
|
pre { |
|
background: #e0f7fa; |
|
padding: 10px; |
|
border-radius: 8px; |
|
} |
|
</style> |
|
</head> |
|
<body> |
|
<div class="logo">❄️🧠</div> |
|
<div class="title">WinterEngine-24B-Instruct</div> |
|
<p class="description">A versatile and powerful model designed for general-purpose text generation, roleplay, storywriting, scientific exploration, and more.</p> |
|
|
|
<div class="details"> |
|
<h3>Key Details</h3> |
|
<pre> |
|
BASE MODEL: mistralai/Mistral-Small-24B-Base-2501 |
|
LICENSE: apache-2.0 |
|
LANGUAGE: English |
|
CONTEXT LENGTH: 32768 tokens |
|
</pre> |
|
</div> |
|
|
|
<div class="settings"> |
|
<h3>Recommended Settings</h3> |
|
<pre> |
|
TEMPERATURE: 1.0 |
|
TOP_P: 0.95 |
|
MIN_P: 0.05 |
|
</pre> |
|
</div> |
|
|
|
<div class="prompt-format"> |
|
<h3>Prompting Format</h3> |
|
<pre> |
|
<|im_start|>system |
|
system prompt<|im_end|> |
|
<|im_start|>user |
|
Hi there!<|im_end|> |
|
<|im_start|>assistant |
|
Nice to meet you!<|im_end|> |
|
</pre> |
|
</div> |
|
</body> |
|
</html> |
|
|
|
|
|
|
|
## 🧩 Configuration |
|
|
|
```yaml |
|
slices: |
|
- sources: |
|
- model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b |
|
layer_range: [0, 40] |
|
- model: SicariusSicariiStuff/Redemption_Wind_24B |
|
layer_range: [0, 40] |
|
merge_method: slerp |
|
base_model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b |
|
parameters: |
|
t: |
|
- filter: self_attn |
|
value: [0, 0.5, 0.3, 0.7, 1] |
|
- filter: mlp |
|
value: [1, 0.5, 0.7, 0.3, 0] |
|
- value: 0.5 |
|
dtype: bfloat16 |
|
``` |
