Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ base_model:
|
|
20 |
|
21 |
Some of the best german models with 7b parameters as an dare_ties merge.
|
22 |
Since the original models based on mistral - three of them on the brilliant german LeoLM/leo-mistral-hessianai-7b - they are reunited in this merged model.
|
23 |
-
Hence the name. To improve result quality they are trained with a german translation of oaast-dpo using our german fork of [LLaMA-Factory](https://github.com/mayflower/LLaMA-Factory).
|
24 |
|
25 |
Wiedervereinigung-7b itself is a [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing) merge of:
|
26 |
* [DiscoResearch/DiscoLM_German_7b_v1](https://huggingface.co/DiscoResearch/DiscoLM_German_7b_v1)
|
@@ -28,6 +28,8 @@ Wiedervereinigung-7b itself is a [LazyMergekit](https://colab.research.google.c
|
|
28 |
* [VAGOsolutions/SauerkrautLM-7b-v1-mistral](https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-v1-mistral)
|
29 |
* [malteos/hermeo-7b](https://huggingface.co/malteos/hermeo-7b)
|
30 |
|
|
|
|
|
31 |
## 🧩 Configuration
|
32 |
|
33 |
```yaml
|
|
|
20 |
|
21 |
Some of the best german models with 7b parameters as an dare_ties merge.
|
22 |
Since the original models based on mistral - three of them on the brilliant german LeoLM/leo-mistral-hessianai-7b - they are reunited in this merged model.
|
23 |
+
Hence the name. To improve result quality they are dpo-trained with a german translation of oaast-dpo using our german fork of [LLaMA-Factory](https://github.com/mayflower/LLaMA-Factory).
|
24 |
|
25 |
Wiedervereinigung-7b itself is a [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing) merge of:
|
26 |
* [DiscoResearch/DiscoLM_German_7b_v1](https://huggingface.co/DiscoResearch/DiscoLM_German_7b_v1)
|
|
|
28 |
* [VAGOsolutions/SauerkrautLM-7b-v1-mistral](https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-v1-mistral)
|
29 |
* [malteos/hermeo-7b](https://huggingface.co/malteos/hermeo-7b)
|
30 |
|
31 |
+
All the actual heavylifting has been done by the creators of these models.
|
32 |
+
|
33 |
## 🧩 Configuration
|
34 |
|
35 |
```yaml
|