Hugging Face's logo

l3utterfly
/
Llama-3SOME-8B-v2-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
l3utterfly commited on
Commit
23d43ad
·
1 Parent(s): 3ad8645

Add quantised GGUF files

Browse files
Files changed (9) hide show
  1. .gitattributes +1 -0
  2. Llama-3SOME-8B-v2-Q2_K.gguf +3 -0
  3. Llama-3SOME-8B-v2-Q4_0_4_4.gguf +3 -0
  4. Llama-3SOME-8B-v2-Q4_0_4_8.gguf +3 -0
  5. Llama-3SOME-8B-v2-Q4_0_8_8.gguf +3 -0
  6. Llama-3SOME-8B-v2-Q4_K_M.gguf +3 -0
  7. Llama-3SOME-8B-v2-Q6_K.gguf +3 -0
  8. Llama-3SOME-8B-v2-Q8_0.gguf +3 -0
  9. Llama-3SOME-8B-v2-f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3SOME-8B-v2-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b9ee79a96a7e6af35d21ff673eccc30ea14139973aceb38f85ccf41e1a1a4c2
3
+ size 3179131552
Llama-3SOME-8B-v2-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f6f1ce9f2e08ab115a0332e6dc74b543a5e955c854cab6793d0e2e8c2d5bee1
3
+ size 4661211808
Llama-3SOME-8B-v2-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bee26079d63218c03de3fe63f56d074289ac9a4f2554daa73c1550ebc4083ed1
3
+ size 4661211808
Llama-3SOME-8B-v2-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb73ec50e1a076ee4dbd102506b7b5e3b335209168a83a8478dd9c71640c3d87
3
+ size 4661211808
Llama-3SOME-8B-v2-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:741998ca198f0c67f133f634e1e71998e8a77da4025cf2abf46f2174244f614b
3
+ size 4920734368
Llama-3SOME-8B-v2-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8611a37d9bf13c682c35e5687db4597e6360712b15491a88b9950c73d318692b
3
+ size 6596006560
Llama-3SOME-8B-v2-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86ca290a61089ffb34e6bb26f5a7279da62604006020a7f0fb69cb03ca8d185e
3
+ size 8540770976
Llama-3SOME-8B-v2-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:980f6ba108acad4c58b97025e8e4895a8eb6a3eaa12e25b2d22f6a38c4c4f115
3
+ size 16068891296