unsloth
/

Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

VRAM requirements?

#3 opened 5 months ago by

Doesn't work with vLLM

#2 opened 5 months ago by

Eryk-Chmielewski

Assertion error while loading the model

#1 opened 5 months ago by