PointerHQ
/

Qwen2.5-VL-72B-Instruct-Pointer-AWQ

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

imjliao commited on Feb 21

Commit

72a5c38

·

verified ·

1 Parent(s): a59e2a4

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -13,6 +13,10 @@ base_model:
 - Qwen/Qwen2.5-VL-72B-Instruct
 ---
 # Qwen2.5-VL-72B-Instruct
 <a href="https://chat.qwenlm.ai/" target="_blank" style="margin: 2px;">
     <img alt="Chat" src="https://img.shields.io/badge/%F0%9F%92%9C%EF%B8%8F%20Qwen%20Chat%20-536af5" style="display: inline-block; vertical-align: middle;"/>

 - Qwen/Qwen2.5-VL-72B-Instruct
 ---
+# Qwen2.5-VL-72B-Instruct-AWQ
+This model doesn't work with `--tensor-parallel 2` yet.
 # Qwen2.5-VL-72B-Instruct
 <a href="https://chat.qwenlm.ai/" target="_blank" style="margin: 2px;">
     <img alt="Chat" src="https://img.shields.io/badge/%F0%9F%92%9C%EF%B8%8F%20Qwen%20Chat%20-536af5" style="display: inline-block; vertical-align: middle;"/>