metadata

language:
  - en
  - zh
  - fr
  - es
  - de
  - pt
  - ru
  - it
  - ja
  - ko
  - vi
  - ar
tags:
  - pytorch
  - text-generation
  - causal-lm
  - rwkv
license: apache-2.0
datasets:
  - HuggingFaceFW/fineweb-edu
  - mlfoundations/dclm-baseline-1.0
  - cerebras/SlimPajama-627B
  - EleutherAI/pile
  - bigcode/starcoderdata
  - oscar-corpus/OSCAR-2301

RWKV7-G1 "GooseOne" pure RNN reasoning model

More info & Gradio demo: https://rwkv.com/

For developers: https://github.com/BlinkDL/RWKV-LM

Use rwkv pip package 0.8.29+ for RWKV-7 inference: https://pypi.org/project/rwkv/

!!! There should not be any space at the end of your input (so strip it) or you will upset the tokenizer and see non-English reponse !!!

Chat prompt (better replace all \n\n in your_prompt to \n):

User: your_prompt

Assistant:

Think prompt:

User: your_prompt

Assistant: <think

Fake think prompt (nice):

User: your_prompt

Assistant: <think>
</think>