Update README.md
Browse files
README.md
CHANGED
|
@@ -5,6 +5,8 @@ datasets:
|
|
| 5 |
language:
|
| 6 |
- en
|
| 7 |
---
|
|
|
|
|
|
|
| 8 |
This is an RWKV-v5 ("Eagle") RNN language model pretrained on 7B of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
|
| 9 |
|
| 10 |
The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.
|
|
|
|
| 5 |
language:
|
| 6 |
- en
|
| 7 |
---
|
| 8 |
+
This is a safetensors formated version of [EleutherAI/Hermes-RWKV-v5-7B](https://huggingface.co/EleutherAI/Hermes-RWKV-v5-7B) for use in [ai00](https://github.com/cgisky1980/ai00_rwkv_server) or [rwkv-runner](https://github.com/josStorer/RWKV-Runner)
|
| 9 |
+
|
| 10 |
This is an RWKV-v5 ("Eagle") RNN language model pretrained on 7B of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
|
| 11 |
|
| 12 |
The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.
|