Update README.md
Browse files
README.md
CHANGED
|
@@ -30,6 +30,14 @@ license: apache-2.0
|
|
| 30 |
- Translation tasks
|
| 31 |
- Chain-of-Thought reasoning tasks
|
| 32 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
### Important Note
|
| 34 |
- Set the end token as '\n\n\x17'
|
| 35 |
```
|
|
|
|
| 30 |
- Translation tasks
|
| 31 |
- Chain-of-Thought reasoning tasks
|
| 32 |
|
| 33 |
+
### How to use
|
| 34 |
+
- Install latest RWKV-Infer (Linux,WSL)
|
| 35 |
+
- make folder 'models'
|
| 36 |
+
```
|
| 37 |
+
curl http://127.0.0.1:9000/loadmodel -X POST -H "Content-Type: application/json" -d '{"model_filename":"models/rwkv-x070-2b9-cje-instruct-1.pth","model_viewname":"RWKV x070 2B9 CJE Instruct-1","model_strategy":"fp16","endtoken":"\\n\\n\\x17"}'
|
| 38 |
+
```
|
| 39 |
+
- Enjou with openai compatible api http://127.0.0.1:9000/v1 :)
|
| 40 |
+
|
| 41 |
### Important Note
|
| 42 |
- Set the end token as '\n\n\x17'
|
| 43 |
```
|