Spaces:

yusufs
/

vllm-inference

Paused

App Files Files

1 contributor

History: 25 commits

yusufs's picture

feat(download-model): add download model at runtime

fc30f26 4 months ago

.gitignore

5 Bytes

feat(first-commit): follow examples and tutorials 4 months ago
Dockerfile
665 Bytes

feat(download-model): add download model at runtime 4 months ago
README.md

1.67 kB

feat(download-model): add download model at runtime 4 months ago
download_model.py

318 Bytes

feat(download-model): add download model at runtime 4 months ago
main.py

6.7 kB

feat(parse): parse output 4 months ago
openai_compatible_api_server.py

24.4 kB

feat(endpoint): add prefix /api on each endpoint 4 months ago
poetry.lock

426 kB

feat(refactor): move the files to root 4 months ago
pyproject.toml

416 Bytes

feat(refactor): move the files to root 4 months ago
requirements.txt

9.99 kB

feat(first-commit): follow examples and tutorials 4 months ago
run.sh

684 Bytes

feat(download-model): add download model at runtime 4 months ago