Update README.md
Browse files
README.md
CHANGED
|
@@ -39,6 +39,10 @@ For developers: https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v7
|
|
| 39 |
|
| 40 |
RWKV-7 trained on 100+ world languages (80% English, 10% multilang, 10% code).
|
| 41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
Recommended fine-tuning format (use \n for newlines):
|
| 43 |
```
|
| 44 |
User: xxxxxxxxxxxxxxx
|
|
|
|
| 39 |
|
| 40 |
RWKV-7 trained on 100+ world languages (80% English, 10% multilang, 10% code).
|
| 41 |
|
| 42 |
+
World-v3 = 3.1T tokens
|
| 43 |
+
World-v2.9 = subsampled 2T tokens
|
| 44 |
+
World-v2.8 = subsampled 1T tokens
|
| 45 |
+
|
| 46 |
Recommended fine-tuning format (use \n for newlines):
|
| 47 |
```
|
| 48 |
User: xxxxxxxxxxxxxxx
|