Hugging Face's logo

MaziyarPanahi
/
QwQ-32B-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
1

[WIP] Upload folder using huggingface_hub (multi-commit 98ff2ed1cf390ae57a5f75cf27c851285edc407fda358bf5de8fb8d25325c39a)

#1
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+28
-0
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. QwQ-32B.Q2_K.gguf +3 -0
  3. QwQ-32B.Q3_K_L.gguf +3 -0
  4. QwQ-32B.Q3_K_M.gguf +3 -0
  5. QwQ-32B.Q3_K_S.gguf +3 -0
  6. QwQ-32B.Q4_K_M.gguf +3 -0
  7. QwQ-32B.Q4_K_S.gguf +3 -0
  8. QwQ-32B.Q5_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ QwQ-32B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ QwQ-32B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ QwQ-32B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ QwQ-32B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ QwQ-32B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ QwQ-32B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ QwQ-32B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
QwQ-32B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f4715a1a39e6f6127b30e371a97f545b42d4ba5cc01739ac69395f5a14e1f7d
3
+ size 12313707552
QwQ-32B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69f514021d82cd7780e66c7c55e6905424494715731b539b65a323b09f9aba9f
3
+ size 17247687712
QwQ-32B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:052024e951e1251e53ba8e71ff5597a6a31fc125a51eeeec5262b5b4f976f299
3
+ size 15935656992
QwQ-32B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35386e8c1943d7078c76f0f7617762adc4c5ff50f003e871e5b39d0add75c557
3
+ size 14392939552
QwQ-32B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec4b3d17087af8d8414c1de85269d5fbc396277a99d949f75ca42ff52e7d09d4
3
+ size 19851944992
QwQ-32B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9ff315297335bdca9cd0c2bdbcecb1b0cc88f58ac4b5450bf1c7da46f62012e
3
+ size 18785018912
QwQ-32B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d6d4d69cc099c50a5dd0f4a1235e0733b3b48ae9e53b6c749c580b9865860d9
3
+ size 23262766112