What is the minimum GPU usage for the Qwen2.5-VL-7B-Instruct-GPTQ-Int4?
#2
by
Xtracta-Qiming
- opened
Hi,
It is a great sharing! I want to know what is the minimum GPU usage for the Qwen2.5-VL-7B-Instruct-GPTQ-Int4? Can I train the model with lora adapter tunning using a single A4090 GPU?
We don't have 4090 at hand. Maybe you can just download and give it a try.
Moreover, if you have successfully run Qwen2-VL-GPTQ-int4, then you'll probably fine this model too.