convergence-ai
/

proxy-lite-3b

text-generation-inference

Model card Files Files and versions

XanderJC commited on Feb 26

Commit

d5b7c14

·

verified ·

1 Parent(s): 92fe8d8

Update README.md

fix vllm serve command

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -67,7 +67,7 @@ You can use this [endpoint](https://huggingface.co/spaces/convergence-ai/demo-ap
 We recommend hosting your own endpoint with vLLM, you can use the following command:
 ```bash
-vllm serve --model convergence-ai/proxy-lite-3b \
     --trust-remote-code \
     --enable-auto-tool-choice \
     --tool-call-parser hermes \

 We recommend hosting your own endpoint with vLLM, you can use the following command:
 ```bash
+vllm serve convergence-ai/proxy-lite-3b \
     --trust-remote-code \
     --enable-auto-tool-choice \
     --tool-call-parser hermes \