cshared commited on
Commit
a6bbc9d
·
verified ·
1 Parent(s): 3851ca2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -5,7 +5,7 @@ base_model:
5
  base_model_relation: quantized
6
  pipeline_tag: text-generation
7
  ---
8
- Disclamer: I don't know what I'm doing. I am not an expert at quantizing.
9
 
10
  Original Model: https://huggingface.co/Qwen/QwQ-32B
11
  | QwQ 32B EXL2 | Size |
@@ -13,10 +13,10 @@ Original Model: https://huggingface.co/Qwen/QwQ-32B
13
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-8.0bpw-exl2">**8.0bpw**</a> | 33.5 GB |
14
  | ~7.0bpw~ | WIP |
15
  | ~6.5bpw~ | WIP |
16
- | ~6.0bpw~ | WIP |
17
  | ~5.5bpw~ | WIP |
18
- | ~5.0bpw~ | WIP |
19
  | ~4.5bpw~ | WIP |
20
- | ~4.0bpw~ | WIP |
21
  | ~3.75bpw~ | WIP |
22
  | ~3.5bpw~ | WIP |
 
5
  base_model_relation: quantized
6
  pipeline_tag: text-generation
7
  ---
8
+ Disclamer: I don't know what I'm doing.
9
 
10
  Original Model: https://huggingface.co/Qwen/QwQ-32B
11
  | QwQ 32B EXL2 | Size |
 
13
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-8.0bpw-exl2">**8.0bpw**</a> | 33.5 GB |
14
  | ~7.0bpw~ | WIP |
15
  | ~6.5bpw~ | WIP |
16
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">**6.0bpw**</a> | 25.6 GB |
17
  | ~5.5bpw~ | WIP |
18
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.0bpw-exl2">**5.0bpw**</a> | 21.7 GB |
19
  | ~4.5bpw~ | WIP |
20
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-4.0bpw-exl2">**4.0bpw**</a> | 17.8 GB |
21
  | ~3.75bpw~ | WIP |
22
  | ~3.5bpw~ | WIP |