Update README.md
Browse files
README.md
CHANGED
@@ -32,6 +32,74 @@ The following models were included in the merge:
|
|
32 |
|
33 |
The following YAML configuration was used to produce this model:
|
34 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
```yaml
|
36 |
merge_method: model_stock
|
37 |
|
|
|
32 |
|
33 |
The following YAML configuration was used to produce this model:
|
34 |
|
35 |
+
```yaml
|
36 |
+
merge_method: slerp
|
37 |
+
base_model: Cran-May/tempemotacilla-messieropussm8-0308
|
38 |
+
models:
|
39 |
+
- model: Cran-May/tempemotacilla-miscii0218-0302
|
40 |
+
- model: Cran-May/tempemotacilla-messieropussm8-0308
|
41 |
+
parameters:
|
42 |
+
t: 0.4
|
43 |
+
dtype: bfloat16
|
44 |
+
name: merge_model_1
|
45 |
+
---
|
46 |
+
merge_method: breadcrumbs_ties
|
47 |
+
base_model: Cran-May/tempemotacilla-miscii0218-0302
|
48 |
+
tokenizer_source: Cran-May/tempemotacilla-miscii0218-0302
|
49 |
+
name: merge_model_2
|
50 |
+
models:
|
51 |
+
- model: Cran-May/tempemotacilla-miscii0218-0302
|
52 |
+
parameters:
|
53 |
+
weight: 1.0
|
54 |
+
- model: Cran-May/tempemotacilla-lix14Bv0.1-0308
|
55 |
+
parameters:
|
56 |
+
weight: 0.75
|
57 |
+
dtype: bfloat16
|
58 |
+
---
|
59 |
+
merge_method: task_arithmetic
|
60 |
+
base_model: Cran-May/tempemotacilla-sombreroopussm1-0308
|
61 |
+
tokenizer_source: Cran-May/tempemotacilla-messieropussm8-0308
|
62 |
+
name: merge_model_3
|
63 |
+
models:
|
64 |
+
- model: Cran-May/tempemotacilla-vipercoderv1.7vsm6-0308
|
65 |
+
parameters:
|
66 |
+
weight: 1.0
|
67 |
+
- model: Cran-May/tempemotacilla-sombreroopussm5-0308
|
68 |
+
parameters:
|
69 |
+
weight: 0.9
|
70 |
+
tokenizer_source: base
|
71 |
+
dtype: bfloat16
|
72 |
+
---
|
73 |
+
merge_method: slerp
|
74 |
+
base_model: Cran-May/tempemotacilla-messieropussm8-0308
|
75 |
+
models:
|
76 |
+
- model: Cran-May/tempemotacilla-messieropuselite12-0308
|
77 |
+
- model: Cran-May/tempemotacilla-messieropussm8-0308
|
78 |
+
parameters:
|
79 |
+
t: 0.5
|
80 |
+
tokenizer_source: base
|
81 |
+
dtype: bfloat16
|
82 |
+
name: merge_model_4
|
83 |
+
---
|
84 |
+
merge_method: model_stock
|
85 |
+
|
86 |
+
base_model: Cran-May/tempemotacilla-miscii0218-0302
|
87 |
+
|
88 |
+
models:
|
89 |
+
- model: Cran-May/tempemotacilla-miscii0218-0302
|
90 |
+
- model: merge_model_1
|
91 |
+
- model: merge_model_2
|
92 |
+
- model: merge_model_3
|
93 |
+
- model: merge_model_4
|
94 |
+
|
95 |
+
dtype: bfloat16
|
96 |
+
|
97 |
+
pad_to_multiple_of: 512
|
98 |
+
tokenizer_source: base
|
99 |
+
|
100 |
+
name: tempmotacilla-cinerea-0308
|
101 |
+
```
|
102 |
+
|
103 |
```yaml
|
104 |
merge_method: model_stock
|
105 |
|