Update README.md

README.md

@@ -19,12 +19,16 @@ language:
 ---
 
 # Wiedervereinigung-7b-dpo
-
+LoneStriker/Wiedervereinigung-7b-dpo-4.0bpw-h6-exl2
 ![image/png](https://huggingface.co/mayflowergmbh/Wiedervereinigung-7b/resolve/main/Wiedervereinigung-7b.png)
 
 This is a dpo aligned merge of our favourite german models, scoring 7.11 on the mt-bench-de average.
 Since the original models based on mistral - three of them on the brilliant german LeoLM/leo-mistral-hessianai-7b - they are reunited in this merged model. 
-Therefore the name, no nationalist ideas involved :-). To improve result quality they are dpo-trained with a german translation of intel-orca-dpo we added support for 10 german datasets to [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory).
+Therefore the name, no nationalist ideas involved :-). 
+
+To improve result quality they are dpo-trained with a german translation of slimorca dpo using hermeo-7B for reject results. 
+
+If you are gpu-poor like me you can now use [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory) to train with german datasets.
 
 Kudos to the authors of the original models at [DiscoResearch](https://huggingface.co/DiscoResearch) and [VAGOsolutions](https://huggingface.co/VAGOsolutions), [Malte Ostendorff](https://huggingface.co/malteos) 
 and [Matthias Uhlig](https://huggingface.co/DRXD1000). We are your fan club.
@@ -53,8 +57,23 @@ Is the merged model alone already good? Well, of course. But it is even better w
 }
 ```
 
+## Other Versions
+
+A big thank you to [LoneStriker](https://huggingface.co/LoneStriker) for the quantized models.
+
+| Name | Quant method | Bits | 
+| ---- | ---- | ---- | 
+[Wiedervereinigung-7b-dpo-GPTQ](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-GPTQ)| Unquantized | 16 |
+[Wiedervereinigung-7b-dpo-GPTQ](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-GPTQ)| GPTQ | 4 |
+[Wiedervereinigung-7b-dpo-AWQ](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-AWQ)| AWQ | 4 |
+[Wiedervereinigung-7b-dpo-GGUF](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-GGUF)| GGUF | 3-8 |
+[Wiedervereinigung-7b-dpo-8.0bpw-h8-exl2](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-8.0bpw-h8-exl2)| EXL2 | 8 |
+[Wiedervereinigung-7b-dpo-6.0bpw-h6-exl2](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-6.0bpw-h6-exl2)| EXL2 | 6 |
+[Wiedervereinigung-7b-dpo-5.0bpw-h6-exl2](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-5.0bpw-h6-exl2)| EXL2 | 5 |
+[Wiedervereinigung-7b-dpo-4.0bpw-h6-exl2](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-4.0bpw-h6-exl2)| EXL2 | 4 |
+[Wiedervereinigung-7b-dpo-3.0bpw-h6-exl2](https://huggingface.co/LoneStriker/Wiedervereinigung-7b-dpo-3.0bpw-h6-exl2)| EXL2 | 3 |
 
-Wiedervereinigung-7b itself is a  [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing) merge of:
+Wiedervereinigung-7b is a  [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing) merge of:
 * [DiscoResearch/DiscoLM_German_7b_v1](https://huggingface.co/DiscoResearch/DiscoLM_German_7b_v1)
 * [DRXD1000/Phoenix](https://huggingface.co/DRXD1000/Phoenix)
 * [VAGOsolutions/SauerkrautLM-7b-v1-mistral](https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-v1-mistral)
@@ -101,7 +120,7 @@ import transformers
 import torch
 
 model = "mayflowergmbh/Wiedervereinigung-7b-dpo"
-messages = [{"role": "user", "content": "Was ist ein deutsches large language model?"}]
+messages = [{"role": "user", "content": "Was ist ein deutsches Large Language Model?"}]
 
 tokenizer = AutoTokenizer.from_pretrained(model)
 prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)