PointerHQ
/

Qwen2.5-VL-72B-Instruct-Pointer-AWQ

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

imjliao commited on Feb 21

Commit

c0833c4

·

verified ·

1 Parent(s): f335095

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -13,9 +13,9 @@ base_model:
 - Qwen/Qwen2.5-VL-72B-Instruct
 ---
-# Qwen2.5-VL-72B-Instruct-AWQ
-This model doesn't work with `--tensor-parallel 2` yet (support comming soon).
 # Qwen2.5-VL-72B-Instruct
 <a href="https://chat.qwenlm.ai/" target="_blank" style="margin: 2px;">

 - Qwen/Qwen2.5-VL-72B-Instruct
 ---
+# Qwen2.5-VL-72B-Instruct-Pointer-AWQ
+This model supports `--tensor-parallel` with 2, 4 or 8 GPUs. Use `vllm==0.7.3`.
 # Qwen2.5-VL-72B-Instruct
 <a href="https://chat.qwenlm.ai/" target="_blank" style="margin: 2px;">