Spaces:

yusufs
/

vllm-inference

Paused

yusufs commited on Jan 28

Commit

1530e6e

1 Parent(s): 57f9fa5

feat(runner.sh): --trust-remote-code

Files changed (1) hide show

runner.sh CHANGED Viewed

@@ -62,4 +62,5 @@ python -u /app/openai_compatible_api_server.py \
     --enforce-eager \
     --gpu-memory-utilization 0.9 \
     --enable-prefix-caching \
-    --disable-log-requests

     --enforce-eager \
     --gpu-memory-utilization 0.9 \
     --enable-prefix-caching \
+    --disable-log-requests \
+    --trust-remote-code