Hugging Face's logo

cshared
/
Qwen-QwQ-32B-8.0bpw-exl2

Text Generation
Safetensors
qwen2
conversational
8-bit precision
exl2
Model card Files Community
cshared commited on
Commit
3feca2f
·
verified ·
1 Parent(s): b307354

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -11,7 +11,7 @@ Original Model: https://huggingface.co/Qwen/QwQ-32B
11
  | QwQ 32B EXL2 | Size |
12
  | --- | --- |
13
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-8.0bpw-exl2">**8.0bpw**</a> | 33.5 GB |
14
- | ~7.0bpw~ | WIP |
15
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.5bpw-exl2">**6.5bpw**</a> | 27.5 GB |
16
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">**6.0bpw**</a> | 25.6 GB |
17
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.5bpw-exl2">**5.5bpw**</a> | 23.6 GB |
 
11
  | QwQ 32B EXL2 | Size |
12
  | --- | --- |
13
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-8.0bpw-exl2">**8.0bpw**</a> | 33.5 GB |
14
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-7.0bpw-exl2">**7.0bpw**</a> | 29.6 GB |
15
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.5bpw-exl2">**6.5bpw**</a> | 27.5 GB |
16
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">**6.0bpw**</a> | 25.6 GB |
17
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.5bpw-exl2">**5.5bpw**</a> | 23.6 GB |