Upload 2 files
Browse files
2B Orpo/RWKV-x060-2B-Pretrain68-Orpo-8-0.0009.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:24d69a476859d2188573b1434412781f58e7946ef15460571d277e89adaaa694
|
| 3 |
+
size 4087662942
|
2B Orpo/readme.md
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
RWKV x060 2B Orpo+State-tuning Experiment
|