xiaol commited on
Commit
ec82622
·
verified ·
1 Parent(s): f5c691d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -29,7 +29,7 @@ library_name: transformers
29
 
30
  **ALL YOU NEED IS RWKV**
31
 
32
- This is an **early preview** of our 7B parameter hybrid RNN-Transformer model, trained on 2k context length(only stage-2 applied, without SFT or DPO) through 3-stage knowledge distillation from Qwen2.5-7B-Instruct. While being a foundational version, it demonstrates:
33
 
34
  - ✅ RWKV-7's efficient recurrence mechanism
35
  - ✅ No self-attention, fully O(n)
 
29
 
30
  **ALL YOU NEED IS RWKV**
31
 
32
+ This is an **early preview** of our 7B parameter hybrid RNN-Transformer model, trained on 2k context length **(only stage-2 applied, without SFT or DPO)** through 3-stage knowledge distillation from Qwen2.5-7B-Instruct. While being a foundational version, it demonstrates:
33
 
34
  - ✅ RWKV-7's efficient recurrence mechanism
35
  - ✅ No self-attention, fully O(n)