Create README.md

README.md

@@ -0,0 +1,64 @@
+---
+base_model:
+- cgato/Thespis-CurtainCall-7b-v0.2.2
+- mistralai/Mistral-7B-v0.1
+- tavtav/eros-7b-test
+- cgato/Thespis-7b-v0.5-SFTTest-2Epoch
+- NeverSleep/Noromaid-7B-0.4-DPO
+- NurtureAI/neural-chat-7b-v3-1-16k
+tags:
+- mergekit
+- merge
+license: cc-by-nc-4.0
+---
+# LemonadeRP-4.5.3
+
+This is a merge of pre-trained language models created by KatyTheCutie
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [cgato/Thespis-CurtainCall-7b-v0.2.2](https://huggingface.co/cgato/Thespis-CurtainCall-7b-v0.2.2)
+* [tavtav/eros-7b-test](https://huggingface.co/tavtav/eros-7b-test)
+* [cgato/Thespis-7b-v0.5-SFTTest-2Epoch](https://huggingface.co/cgato/Thespis-7b-v0.5-SFTTest-2Epoch)
+* [NeverSleep/Noromaid-7B-0.4-DPO](https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO)
+* [NurtureAI/neural-chat-7b-v3-1-16k](https://huggingface.co/NurtureAI/neural-chat-7b-v3-1-16k)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: mistralai/Mistral-7B-v0.1
+dtype: float16
+merge_method: task_arithmetic
+slices:
+- sources:
+  - layer_range: [0, 32]
+    model: mistralai/Mistral-7B-v0.1
+  - layer_range: [0, 32]
+    model: NeverSleep/Noromaid-7B-0.4-DPO
+    parameters:
+      weight: 0.37
+  - layer_range: [0, 32]
+    model: cgato/Thespis-CurtainCall-7b-v0.2.2
+    parameters:
+      weight: 0.32
+  - layer_range: [0, 32]
+    model: NurtureAI/neural-chat-7b-v3-1-16k
+    parameters:
+      weight: 0.15
+  - layer_range: [0, 32]
+    model: cgato/Thespis-7b-v0.5-SFTTest-2Epoch
+    parameters:
+      weight: 0.38
+  - layer_range: [0, 32]
+    model: tavtav/eros-7b-test
+    parameters:
+      weight: 0.18
+```