Does VLLM support this model?
#2
by
MRU4913
- opened
Does VLLM provide support for this particular model? Are the features and infrastructure within VLLM configured in a way that can accommodate and effectively utilize this model?
The model is supported in vLLM! Here's the PR with the updated docs for reference https://github.com/vllm-project/vllm/pull/23584
alexrs
changed discussion status to
closed