Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -756,7 +756,7 @@ print(sess.response.text)
|
|
| 756 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 757 |
|
| 758 |
```shell
|
| 759 |
-
lmdeploy serve api_server OpenGVLab/InternVL3_5-8B --server-port 23333 --tp 1
|
| 760 |
```
|
| 761 |
|
| 762 |
To use the OpenAI-style interface, you need to install OpenAI:
|
|
|
|
| 756 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 757 |
|
| 758 |
```shell
|
| 759 |
+
lmdeploy serve api_server OpenGVLab/InternVL3_5-8B --server-port 23333 --tp 1 --backend pytorch
|
| 760 |
```
|
| 761 |
|
| 762 |
To use the OpenAI-style interface, you need to install OpenAI:
|