Hugging Face's logo

cshared
/
Qwen-QwQ-32B-8.0bpw-exl2

Text Generation
Safetensors
qwen2
conversational
8-bit precision
exl2
Model card Files Community
cshared commited on
Commit
b307354
·
verified ·
1 Parent(s): e4f6b5f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -14,9 +14,9 @@ Original Model: https://huggingface.co/Qwen/QwQ-32B
14
  | ~7.0bpw~ | WIP |
15
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.5bpw-exl2">**6.5bpw**</a> | 27.5 GB |
16
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">**6.0bpw**</a> | 25.6 GB |
17
- | ~5.5bpw~ | WIP |
18
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.0bpw-exl2">**5.0bpw**</a> | 21.7 GB |
19
- | ~4.5bpw~ | WIP |
20
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-4.0bpw-exl2">**4.0bpw**</a> | 17.8 GB |
21
- | ~3.75bpw~ | WIP |
22
  | ~3.5bpw~ | WIP |
 
14
  | ~7.0bpw~ | WIP |
15
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.5bpw-exl2">**6.5bpw**</a> | 27.5 GB |
16
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">**6.0bpw**</a> | 25.6 GB |
17
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.5bpw-exl2">**5.5bpw**</a> | 23.6 GB |
18
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.0bpw-exl2">**5.0bpw**</a> | 21.7 GB |
19
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-4.5bpw-exl2">**4.5bpw**</a> | 19.7 GB |
20
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-4.0bpw-exl2">**4.0bpw**</a> | 17.8 GB |
21
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-3.75bpw-exl2">**3.75bpw**</a> | 16.8 GB |
22
  | ~3.5bpw~ | WIP |