OpenMOSE
/

ARWKV-7B-Preview-0.1-Pytorch

Model card Files Files and versions

OpenMOSE commited on Feb 18

Commit

973e549

·

verified ·

1 Parent(s): 395b512

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ Answer user questions in Reasoning mode.
 for using
 1. install RWKV-Infer(see how to install)
 2. loadmodel(choose FP16 or FP6 or FP5 (dont choose FP8))
-2.1. need 19GB VRAM in FP16, 12GB VRAM in FP6
 ```
 curl http://127.0.0.1:9000/loadmodel -X POST -H "Content-Type: application/json" -d '{"model_filename":"models/ARWKV-7B-CJE-30%.pth","model_viewname":"ARWKV-7B-CJE-30%","model_strategy":"fp16"}'

 for using
 1. install RWKV-Infer(see how to install)
 2. loadmodel(choose FP16 or FP6 or FP5 (dont choose FP8))
+3. need 19GB VRAM in FP16, 12GB VRAM in FP6
 ```
 curl http://127.0.0.1:9000/loadmodel -X POST -H "Content-Type: application/json" -d '{"model_filename":"models/ARWKV-7B-CJE-30%.pth","model_viewname":"ARWKV-7B-CJE-30%","model_strategy":"fp16"}'