Spaces:

yusufs
/

vllm-inference

Paused

App Files Files

1 contributor

History: 29 commits

yusufs's picture

feat(add-model): always download model during build, it will be cached in the consecutive builds

8679a35 4 months ago

.gitignore

5 Bytes

feat(first-commit): follow examples and tutorials 4 months ago
Dockerfile

1.23 kB

feat(add-model): always download model during build, it will be cached in the consecutive builds 4 months ago
README.md

1.73 kB

feat(add-model): always download model during build, it will be cached in the consecutive builds 4 months ago
download_model.py

700 Bytes

feat(add-model): always download model during build, it will be cached in the consecutive builds 4 months ago
main.py

6.7 kB

feat(parse): parse output 4 months ago
openai_compatible_api_server.py

24.4 kB

feat(endpoint): add prefix /api on each endpoint 4 months ago
poetry.lock

426 kB

feat(refactor): move the files to root 4 months ago
pyproject.toml

416 Bytes

feat(refactor): move the files to root 4 months ago
requirements.txt

9.99 kB

feat(first-commit): follow examples and tutorials 4 months ago
run-llama.sh

1.51 kB

feat(add-model): always download model during build, it will be cached in the consecutive builds 4 months ago
run-sailor.sh

1.36 kB

feat(add-model): always download model during build, it will be cached in the consecutive builds 4 months ago