prithivMLmods commited on
Commit
9132835
·
verified ·
1 Parent(s): 93b778d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -5
README.md CHANGED
@@ -8,21 +8,24 @@ tags:
8
  - merge
9
 
10
  ---
11
- # merge
 
 
 
 
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
 
15
- ## Merge Details
16
- ### Merge Method
17
 
18
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [prithivMLmods/Calme-Ties-78B](https://huggingface.co/prithivMLmods/Calme-Ties-78B) as a base.
19
 
20
- ### Models Merged
21
 
22
  The following models were included in the merge:
23
  * [MaziyarPanahi/calme-3.1-instruct-78b](https://huggingface.co/MaziyarPanahi/calme-3.1-instruct-78b)
24
 
25
- ### Configuration
26
 
27
  The following YAML configuration was used to produce this model:
28
 
 
8
  - merge
9
 
10
  ---
11
+ # **Calme-Ties2-78B**
12
+
13
+ This model is the result of merging pre-trained language models using the TIES merge method, with prithivMLmods/Calme-Ties-78B serving as the base model. The merged models include MaziyarPanahi/calme-3.1-instruct-78b, with each contributing equally in terms of weight and density. The model configuration was designed with parameters like normalization, int8 masking, and a bfloat16 data type to ensure optimal performance.
14
+
15
+ # **Merge**
16
 
17
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
 
19
+ # **Merge Method**
 
20
 
21
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [prithivMLmods/Calme-Ties-78B](https://huggingface.co/prithivMLmods/Calme-Ties-78B) as a base.
22
 
23
+ # **Models Merged**
24
 
25
  The following models were included in the merge:
26
  * [MaziyarPanahi/calme-3.1-instruct-78b](https://huggingface.co/MaziyarPanahi/calme-3.1-instruct-78b)
27
 
28
+ # **Configuration**
29
 
30
  The following YAML configuration was used to produce this model:
31