OpenMOSE
/

RWKV-x070-2B9-CJE-Instruct

Model card Files Files and versions

OpenMOSE commited on Jan 17

Commit

942f441

·

verified ·

1 Parent(s): 122dd56

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ license: apache-2.0
 ### Training Configuration
 - **Trainer**: RWKV-LM-RLHF
-- **PEFT Mode**: Hybrid learning combining frozen embeddings and Bone (Block Affine Transformation) + full parameter training
 - **SFT Method**: SmoothingLoss SFT
 - **Context Window**: 5120 (trained with 1024 token overlap)

 ### Training Configuration
 - **Trainer**: RWKV-LM-RLHF
+- **PEFT Mode**: Hybrid Training combining frozen embeddings and Bone (Block Affine Transformation) + full parameter training
 - **SFT Method**: SmoothingLoss SFT
 - **Context Window**: 5120 (trained with 1024 token overlap)