File size: 247 Bytes
aa7b104
 
 
 
 
 
 
 
6ae4623
aa7b104
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
---
license: apache-2.0
datasets:
- EleutherAI/pile
---

RWKV-8 trained on the Pile w/ "20b tokenizer" (332115325534 tokens)

Here are early testing versions and I will iterate

How to run it:

https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v7