Darkknight535 commited on
Commit
8bddae9
·
verified ·
1 Parent(s): 5bf86d4

Delete README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -56
README.md DELETED
@@ -1,56 +0,0 @@
1
- ---
2
- base_model:
3
- - ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
4
- - unsloth/Mistral-Small-Instruct-2409
5
- - TheDrummer/Cydonia-22B-v1.2
6
- - TheDrummer/Cydonia-22B-v1.3
7
- library_name: transformers
8
- tags:
9
- - mergekit
10
- - merge
11
-
12
- ---
13
- # merge
14
-
15
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
-
17
- ## Merge Details
18
- ### Merge Method
19
-
20
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [unsloth/Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409) as a base.
21
-
22
- ### Models Merged
23
-
24
- The following models were included in the merge:
25
- * [ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1](https://huggingface.co/ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1)
26
- * [TheDrummer/Cydonia-22B-v1.2](https://huggingface.co/TheDrummer/Cydonia-22B-v1.2)
27
- * [TheDrummer/Cydonia-22B-v1.3](https://huggingface.co/TheDrummer/Cydonia-22B-v1.3)
28
-
29
- ### Configuration
30
-
31
- The following YAML configuration was used to produce this model:
32
-
33
- ```yaml
34
- models:
35
- - model: unsloth/Mistral-Small-Instruct-2409
36
- - model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
37
- parameters:
38
- density: 0.1
39
- weight: 0.1
40
- - model: TheDrummer/Cydonia-22B-v1.3
41
- parameters:
42
- density: 0.6
43
- weight: 0.35
44
- - model: TheDrummer/Cydonia-22B-v1.2
45
- parameters:
46
- density: 0.7
47
- weight: 0.4
48
- merge_method: ties
49
- base_model: unsloth/Mistral-Small-Instruct-2409
50
- parameters:
51
- int8_mask: true
52
- rescale: true
53
- normalize: false
54
- dtype: bfloat16
55
-
56
- ```