File size: 880 Bytes
3b77ba7
e223354
3b77ba7
be7bfce
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e223354
db3be33
e223354
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
---
license: other
---

This model was made by ShotMisser64 using the following mergekit yaml:
```
slices:
  - sources:
    - model: output/Orca2flat
      layer_range: [0, 13]
  - sources:
    - model: PygmalionAI/mythalion-13b
      layer_range: [3, 22]
  - sources:
    - model: output/Orca2flat
      layer_range: [14, 27]
  - sources:
    - model: PygmalionAI/mythalion-13b
      layer_range: [23, 40]
merge_method: passthrough
dtype: float16
```

The Orca2flat model uses the following mergekit yaml:
```
merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
models:
  - model: TheBloke/Llama-2-13B-fp16
  - model: microsoft/Orca-2-13b
    parameters:
      weight: 1.0
dtype: float16
```

Found something interesting or would you like your own custom merge? Visit our community at https://koboldai.org/discord

Please respect the license of the origin models.