Quantized Qwen2.5-VL models
#4
by
fortminors
- opened
Hello! Thank you for publishing amazing work!
Are there any plans on quantized models, such as Qwen2.5-VL-3B-Instruct-GPTQ-Int4?
Looking forward to it!
+1 for quantized models