shubhrapandit commited on
Commit
e9b324d
·
verified ·
1 Parent(s): 4296d21

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -272,7 +272,7 @@ evalplus.evaluate \
272
  ## Inference Performance
273
 
274
 
275
- This model achieves up to 1.9x speedup in single-stream deployment and up to 1.53x speedup in multi-stream asynchronous deployment, depending on hardware and use-case scenario.
276
  The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.7.2, and [GuideLLM](https://github.com/neuralmagic/guidellm).
277
 
278
  <details>
 
272
  ## Inference Performance
273
 
274
 
275
+ This model achieves up to 1.57x speedup in single-stream deployment and up to 1.53x speedup in multi-stream asynchronous deployment, depending on hardware and use-case scenario.
276
  The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.7.2, and [GuideLLM](https://github.com/neuralmagic/guidellm).
277
 
278
  <details>