aa7b104 6ae4623 aa7b104
1
2
3
4
5
6
7
8
9
10
11
12
13
14
--- license: apache-2.0 datasets: - EleutherAI/pile --- RWKV-8 trained on the Pile w/ "20b tokenizer" (332115325534 tokens) Here are early testing versions and I will iterate How to run it: https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v7