support tokenised prompt (online vllm)

#17

by Payoto - opened Oct 3, 2024

←

Payoto

Oct 3, 2024

•

Online vLLM inference passes an already pre-processed text prompt to the multimodal preprocessor.

Payoto

Oct 3, 2024

This comment has been hidden

Payoto changed pull request status to open Oct 3, 2024

Payoto changed pull request status to closed Oct 11, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment