README.md

metadata

license: apache-2.0
datasets:
  - EleutherAI/pile

RWKV-7 trained on the Pile (332B tokens)

Check https://github.com/BlinkDL/RWKV-LM for details.

Use https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v7 to run it.