File size: 4,055 Bytes
c41b1de 6b49cd3 18c8944 c41b1de 6b49cd3 c41b1de 0e53f4d e903508 0e53f4d 86a6a95 0e53f4d 8f66867 0e53f4d 20bf9ee 0e53f4d 810eccc 3008ccf cb19698 0e53f4d 33cdd67 30694c6 dfcdd60 0e53f4d 6b49cd3 0e53f4d 6b49cd3 46079a2 6b49cd3 0e53f4d 6b49cd3 0e53f4d 6b49cd3 0e53f4d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 |
---
base_model: v000000/SwallowMaid-8B-L3-SPPO-abliterated
library_name: transformers
tags:
- mergekit
- merge
- llama-cpp
- llama
- japanese
- english
---
This model was converted to GGUF format from [`v000000/SwallowMaid-8B-L3-SPPO-abliterated`](https://huggingface.co/v000000/SwallowMaid-8B-L3-SPPO-abliterated) using llama.cpp
Refer to the [original model card](https://huggingface.co/v000000/SwallowMaid-8B-L3-SPPO-abliterated) for more details on the model.
<!DOCTYPE html>
<style>
h1 {
color: #a8dafb; /* Red color */
font-size: 1.25em; /* Larger font size */
text-align: left; /* Center alignment */
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.5); /* Shadow effect */
background: linear-gradient(90deg, #a8dafb, #fba8a8); /* Gradient background */
-webkit-background-clip: text; /* Clipping the background to text */
-webkit-text-fill-color: transparent; /* Making the text transparent */
}
p {
color: #a8dafb; /* Red color */
font-size: 1.25em; /* Larger font size */
text-align: left; /* Center alignment */
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.5); /* Shadow effect */
background: linear-gradient(90deg, #a8dafb, #fba8a8); /* Gradient background */
-webkit-background-clip: text; /* Clipping the background to text */
-webkit-text-fill-color: transparent; /* Making the text transparent */
}
</style>
<html lang="en">
<head>
</head>
<body>
# <p>SwallowMaid-8B-Llama-3-SPPO-abliterated</p>
"Llama-3-Instruct-8B-SPPO-Iter3" fully uncensored with 35% RP-Mix infused to gain some roleplay capabilities and prose while attempting to preserve the qualities of Meta's Llama-3-Instruct finetune.
prototype2, in testing
# <h1>merge</h1>
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
# <h1>Merge Details</h1>
# <h1>Merge Method</h1>
This model was merged using a multi-step merge method.
# <h1>Models Merged</h1>
The following models were included in the merge:
* [grimjim/Llama-3-Instruct-abliteration-LoRA-8B](https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-LoRA-8B)
* [UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3](https://huggingface.co/UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3)
* [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS)
* [maldv/llama-3-fantasy-writer-8b](https://huggingface.co/maldv/llama-3-fantasy-writer-8b)
* [tokyotech-llm/Llama-3-Swallow-8B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3-Swallow-8B-v0.1)
* [Nitral-AI/Hathor_Respawn-L3-8B-v0.8](https://huggingface.co/Nitral-AI/Hathor_Respawn-L3-8B-v0.8)
# <h1>Configuration</h1>
The following YAML configuration was used to produce this model:
```yaml
# Part 3, Apply abliteration (SwallowMaid-8B)
models:
- model: sppo-rpmix-part2+grimjim/Llama-3-Instruct-abliteration-LoRA-8B
parameters:
weight: 1.0
merge_method: linear
dtype: float32
# Part 2, infuse 35% swallow+rpmix to SPPO-Iter3 (sppo-rpmix-part2)
models:
- model: UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3
parameters:
weight: 1.0
- model: rpmix-part1
parameters:
weight: 0.35
merge_method: task_arithmetic
base_model: UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3
parameters:
normalize: false
dtype: float32
# Part 1, linear merge rpmix (rpmix-part1)
models:
- model: Nitral-AI/Hathor_Respawn-L3-8B-v0.8
parameters:
weight: 0.6
- model: maldv/llama-3-fantasy-writer-8b
parameters:
weight: 0.1
- model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
parameters:
weight: 0.4
- model: tokyotech-llm/Llama-3-Swallow-8B-v0.1
parameters:
weight: 0.15
merge_method: linear
dtype: float32
```
# <h1>Prompt Template:</h1>
```bash
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{output}<|eot_id|>
```
</body>
</html> |