Qwen/Qwen2.5-1.5B-Instruct-AWQ
Text Generation
•
Updated
•
3.55k
•
4
AWQ quants
AWQ quants of various leading models for benchmarks and testing
-
-
Qwen/Qwen2.5-3B-Instruct-AWQ
Text Generation • Updated • 6.52k • 8 -
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation • Updated • 13.9k • 17 -
Qwen/Qwen2.5-14B-Instruct-AWQ
Text Generation • Updated • 19.2k • 13 -
Qwen/Qwen2-VL-2B-Instruct-AWQ
Image-Text-to-Text • Updated • 7.53k • 20 -
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text • Updated • 78.1k • 45 -
Qwen/Qwen2.5-Coder-14B-Instruct-AWQ
Text Generation • Updated • 16.6k • 6 -
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation • Updated • 592k • 62 -
TheBloke/Mixtral_11Bx2_MoE_19B-AWQ
Text Generation • Updated • 16 • 5 -
TheBloke/TinyLlama-1.1B-Chat-v1.0-AWQ
Text Generation • Updated • 169 • 6 -
internlm/internlm2_5-7b-chat-4bit
Text Generation • Updated • 92 • 5 -
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation • Updated • 1.3k • 6 -
casperhansen/deepseek-r1-distill-qwen-7b-awq
Updated • 2.42k -
casperhansen/deepseek-r1-distill-llama-8b-awq
Updated • 393 -
casperhansen/deepseek-r1-distill-qwen-14b-awq
Updated • 4.95k • 7