Update README.md
Browse files
README.md
CHANGED
|
@@ -127,6 +127,10 @@ curl http://localhost:30000/v1/chat/completions \
|
|
| 127 |
|
| 128 |
```
|
| 129 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 130 |
## Best Practices for Model Configuration
|
| 131 |
To achieve optimal performance, we recommend the following settings:
|
| 132 |
|
|
|
|
| 127 |
|
| 128 |
```
|
| 129 |
|
| 130 |
+
### llama.cpp
|
| 131 |
+
|
| 132 |
+
Thanks @CISCai, support for llama.cpp can be found in the implementation at https://github.com/ggml-org/llama.cpp/pull/15510.
|
| 133 |
+
|
| 134 |
## Best Practices for Model Configuration
|
| 135 |
To achieve optimal performance, we recommend the following settings:
|
| 136 |
|