Hugging Face's logo

duyntnet
/
WizardLM-2-7B-imatrix-GGUF

Text Generation
Transformers
GGUF
English
imatrix
wizardlm
Model card Files Community
duyntnet commited on
Commit
70083e0
·
verified ·
1 Parent(s): 06eda76

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. WizardLM-2-7B-Q4_0.gguf +3 -0
  3. WizardLM-2-7B-Q4_K_M.gguf +3 -0
  4. WizardLM-2-7B-Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -50,3 +50,6 @@ WizardLM-2-7B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
  WizardLM-2-7B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
  WizardLM-2-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
  WizardLM-2-7B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
50
  WizardLM-2-7B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
  WizardLM-2-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
  WizardLM-2-7B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ WizardLM-2-7B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
54
+ WizardLM-2-7B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ WizardLM-2-7B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WizardLM-2-7B-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dddfb2e8450f1d6d9073a41878fe139e7752172947ffe405dd661b50b96f92de
3
+ size 4123596480
WizardLM-2-7B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f89cfc4a8af3661124f3f59b72e957374c2d10630dd29569c661146be2bfcfec
3
+ size 4368438976
WizardLM-2-7B-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79176073f1be287ec7853e5e669014d54265c914b154a4af7e9dd2fba325f205
3
+ size 4140373696