Hugging Face's logo

SpongeEngine
/
Dobby-Mini-Unhinged-Llama-3.1-8B-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
dclipca commited on
Commit
92b0b9f
·
verified ·
1 Parent(s): 89635ae

Upload folder using huggingface_hub

Browse files
Files changed (24) hide show
  1. .gitattributes +22 -0
  2. Dobby-Mini-Unhinged-Llama-3.1-8B.imatrix.dat +3 -0
  3. README.md +26 -0
  4. dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_S.gguf +3 -0
  5. dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_XS.gguf +3 -0
  6. dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_XXS.gguf +3 -0
  7. dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_M.gguf +3 -0
  8. dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_S.gguf +3 -0
  9. dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_XS.gguf +3 -0
  10. dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_XXS.gguf +3 -0
  11. dobby-mini-unhinged-llama-3.1-8b-i1-IQ4_NL.gguf +3 -0
  12. dobby-mini-unhinged-llama-3.1-8b-i1-IQ4_XS.gguf +3 -0
  13. dobby-mini-unhinged-llama-3.1-8b-i1-Q2_K.gguf +3 -0
  14. dobby-mini-unhinged-llama-3.1-8b-i1-Q2_K_S.gguf +3 -0
  15. dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_L.gguf +3 -0
  16. dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_M.gguf +3 -0
  17. dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_S.gguf +3 -0
  18. dobby-mini-unhinged-llama-3.1-8b-i1-Q4_0.gguf +3 -0
  19. dobby-mini-unhinged-llama-3.1-8b-i1-Q4_1.gguf +3 -0
  20. dobby-mini-unhinged-llama-3.1-8b-i1-Q4_K_M.gguf +3 -0
  21. dobby-mini-unhinged-llama-3.1-8b-i1-Q4_K_S.gguf +3 -0
  22. dobby-mini-unhinged-llama-3.1-8b-i1-Q5_K_M.gguf +3 -0
  23. dobby-mini-unhinged-llama-3.1-8b-i1-Q5_K_S.gguf +3 -0
  24. dobby-mini-unhinged-llama-3.1-8b-i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Dobby-Mini-Unhinged-Llama-3.1-8B.imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
45
+ dobby-mini-unhinged-llama-3.1-8b-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
49
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
52
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
53
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
56
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
57
+ dobby-mini-unhinged-llama-3.1-8b-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Dobby-Mini-Unhinged-Llama-3.1-8B.imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e66d345018f593a493482f6cdfa83a70662e655baa136ea03a0f9cd8de9e1914
3
+ size 4988161
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: SentientAGI/Dobby-Mini-Unhinged-Llama-3.1-8B
3
+ language:
4
+ - en
5
+ license: mit
6
+ quantized_by: SpongeQuant
7
+ tags:
8
+ - SpongeQuant
9
+ - i1-GGUF
10
+ ---
11
+
12
+
13
+ Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
+
15
+ <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/078.png" alt="78. Underwater scene with diver and fish">
17
+ <figcaption>78. Underwater scene with diver and fish</figcaption>
18
+ </figure>
19
+
20
+ <figure>
21
+ <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/025.mp3" type="audio/mp3">
23
+ Your browser does not support the audio element.
24
+ </audio>
25
+ <figcaption>25. The Fairie Round – Early Music Consort of London / David Munrow (Anthony Holborne)</figcaption>
26
+ </figure>
dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e3f93ce98d2e3723e7050ead2442cdbedfe5cd108892642953a04de022c380c
3
+ size 2758493920
dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3224ee1c45873751ee5e149e55a336cab01ea4f1b4a3a79dce33ef5684cdb687
3
+ size 2605786848
dobby-mini-unhinged-llama-3.1-8b-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa7b503296d27658bdc11a99a332b39fb3f7d34f44f648defff7c280051cbc08
3
+ size 2399217376
dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d11ddf7c5a424f2f4feb921970cd2694f7ead0271bdf73d65f2173ccdbf6209
3
+ size 3784828640
dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96f80d19fde46c650ada1c7fa3aa83f0154229fadcd432012093b82a5f6b317a
3
+ size 3682330336
dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e85d2798c34b4438e228582a2d4b51abdb125a75c0588a6fa87aee59e04e23bb
3
+ size 3518752480
dobby-mini-unhinged-llama-3.1-8b-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:147b01f8f124810b6c97e4412e40f95b2a2233b24e971e4ebf096930a840e617
3
+ size 3274917600
dobby-mini-unhinged-llama-3.1-8b-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2ef20420dc2a643313c9769321ffec3ab85fb2588028f8fb341e9c72f5436b3
3
+ size 4677994208
dobby-mini-unhinged-llama-3.1-8b-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:591505c72a5a93b68c2c574d3397d1f56940f589d001cdbf324ca5c11e7a54c3
3
+ size 4447667936
dobby-mini-unhinged-llama-3.1-8b-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95dd0579244e6d3b6e1173641a4aa15e5ee327c4e314e2487a8aec06ddb70d4a
3
+ size 3179136736
dobby-mini-unhinged-llama-3.1-8b-i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5b4b03578e5a5a34294841efd2b9bddd2506923a0282f9eab949dbee3fbce97
3
+ size 2988820192
dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4b7dd0e6276697c00c62478f194158dae6f9d6011c0053c4bd8859fbe2812c9
3
+ size 4321961696
dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ac897c625f560e1e32b74b882d9ffb167791cfc0a2fab7cea6b517f652ee804
3
+ size 4018923232
dobby-mini-unhinged-llama-3.1-8b-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc053c90a758184575709118f412bd4b74beb1137ac2dc395538964c01109b43
3
+ size 3664504544
dobby-mini-unhinged-llama-3.1-8b-i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03df38c66b21474aa44364f3cec9487cab16894c80f99d706e205664475c8f14
3
+ size 4675897056
dobby-mini-unhinged-llama-3.1-8b-i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dad4a7faadfdac54f91b9417998d6bb69a3f2d1828ae191a1d07136ec78ec6cf
3
+ size 5130258144
dobby-mini-unhinged-llama-3.1-8b-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a1b8fa15cc8e4b7e9b27b1b269a8d989db16f61c5c082c76aad89f3e8e48926
3
+ size 4920739552
dobby-mini-unhinged-llama-3.1-8b-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:141ecd10da15ebc077baac1505f35bfea7d6b54e7191d6d32c6318a318932cc2
3
+ size 4692674272
dobby-mini-unhinged-llama-3.1-8b-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7ee74d73583efceaa2ec0c4dc00ed5ad79b33d1869c67b2e70b001b8c83b542
3
+ size 5732992736
dobby-mini-unhinged-llama-3.1-8b-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d0c901dbabc622a8654ee86467646dc6ebda0efab1c62b2a260acf4261dd2bb
3
+ size 5599299296
dobby-mini-unhinged-llama-3.1-8b-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0a2a8f94c3724b40f6b54cc0e3ea7a142f0d5d094fc5b8f19e22a4b541c9a9b
3
+ size 6596011744