Hugging Face's logo

SpongeEngine
/
Evil-Alpaca-Right-Lean-L3.2-3B-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
dclipca commited on
Commit
809b66e
·
verified ·
1 Parent(s): 07e50df

Upload folder using huggingface_hub

Browse files
Files changed (24) hide show
  1. .gitattributes +22 -0
  2. Evil-Alpaca-Right-Lean-L3.2-3B.imatrix.dat +3 -0
  3. README.md +26 -0
  4. evil-alpaca-right-lean-l3.2-3b-i1-IQ2_S.gguf +3 -0
  5. evil-alpaca-right-lean-l3.2-3b-i1-IQ2_XS.gguf +3 -0
  6. evil-alpaca-right-lean-l3.2-3b-i1-IQ2_XXS.gguf +3 -0
  7. evil-alpaca-right-lean-l3.2-3b-i1-IQ3_M.gguf +3 -0
  8. evil-alpaca-right-lean-l3.2-3b-i1-IQ3_S.gguf +3 -0
  9. evil-alpaca-right-lean-l3.2-3b-i1-IQ3_XS.gguf +3 -0
  10. evil-alpaca-right-lean-l3.2-3b-i1-IQ3_XXS.gguf +3 -0
  11. evil-alpaca-right-lean-l3.2-3b-i1-IQ4_NL.gguf +3 -0
  12. evil-alpaca-right-lean-l3.2-3b-i1-IQ4_XS.gguf +3 -0
  13. evil-alpaca-right-lean-l3.2-3b-i1-Q2_K.gguf +3 -0
  14. evil-alpaca-right-lean-l3.2-3b-i1-Q2_K_S.gguf +3 -0
  15. evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_L.gguf +3 -0
  16. evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_M.gguf +3 -0
  17. evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_S.gguf +3 -0
  18. evil-alpaca-right-lean-l3.2-3b-i1-Q4_0.gguf +3 -0
  19. evil-alpaca-right-lean-l3.2-3b-i1-Q4_1.gguf +3 -0
  20. evil-alpaca-right-lean-l3.2-3b-i1-Q4_K_M.gguf +3 -0
  21. evil-alpaca-right-lean-l3.2-3b-i1-Q4_K_S.gguf +3 -0
  22. evil-alpaca-right-lean-l3.2-3b-i1-Q5_K_M.gguf +3 -0
  23. evil-alpaca-right-lean-l3.2-3b-i1-Q5_K_S.gguf +3 -0
  24. evil-alpaca-right-lean-l3.2-3b-i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Evil-Alpaca-Right-Lean-L3.2-3B.imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
45
+ evil-alpaca-right-lean-l3.2-3b-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ evil-alpaca-right-lean-l3.2-3b-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ evil-alpaca-right-lean-l3.2-3b-i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
49
+ evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ evil-alpaca-right-lean-l3.2-3b-i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
52
+ evil-alpaca-right-lean-l3.2-3b-i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
53
+ evil-alpaca-right-lean-l3.2-3b-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ evil-alpaca-right-lean-l3.2-3b-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ evil-alpaca-right-lean-l3.2-3b-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
56
+ evil-alpaca-right-lean-l3.2-3b-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
57
+ evil-alpaca-right-lean-l3.2-3b-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Evil-Alpaca-Right-Lean-L3.2-3B.imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5223f9b4081a2affbf4bedcb40d18a2982e803d3712e0131cd7604f1a3534e05
3
+ size 2988381
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: SaisExperiments/Evil-Alpaca-Right-Lean-L3.2-3B
3
+ language:
4
+ - en
5
+ license: mit
6
+ quantized_by: SpongeQuant
7
+ tags:
8
+ - SpongeQuant
9
+ - i1-GGUF
10
+ ---
11
+
12
+
13
+ Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
+
15
+ <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/118.png" alt="118. Statement 2/2">
17
+ <figcaption>118. Statement 2/2</figcaption>
18
+ </figure>
19
+
20
+ <figure>
21
+ <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/022.mp3" type="audio/mp3">
23
+ Your browser does not support the audio element.
24
+ </audio>
25
+ <figcaption>22. Symphony No. 5 in C Minor, Opus 67: I. Allegro Con Brio – Philharmonia Orchestra / Otto Klemperer (Ludwig Van Beethoven)</figcaption>
26
+ </figure>
evil-alpaca-right-lean-l3.2-3b-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1767bc9381ed02cde1083590ff47a29164592b05a718dd0062b026b4899c5b3
3
+ size 1154318624
evil-alpaca-right-lean-l3.2-3b-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c866de28c432b31d55a2c014490f961ecf3bd47716b48df2c0b9f33c5180b7eb
3
+ size 1100546336
evil-alpaca-right-lean-l3.2-3b-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26ae995e4280725c520728ec775c21ea33f94e8b6f42eb104757520de6c67b6a
3
+ size 1017577760
evil-alpaca-right-lean-l3.2-3b-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a4f722c4c03ce02f8b38e249d9b2ab9090f93195b9216ef24035fe1b3a64f2a
3
+ size 1599666464
evil-alpaca-right-lean-l3.2-3b-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19eb5321d552b091beefd330a93582dd2ccd8522502bd97285781345a249d3c3
3
+ size 1542846752
evil-alpaca-right-lean-l3.2-3b-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:147b43f27a9bfc2dac3f033ca58e8024a2736eaa2d2e2e26870d5e34b96d2b00
3
+ size 1476786464
evil-alpaca-right-lean-l3.2-3b-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9df629bc5ba07cf6799ea3aeaebc31fdb0eeb47c60039b280e9c3c6e022ed023
3
+ size 1348763936
evil-alpaca-right-lean-l3.2-3b-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e903152b9c12e9d65971e6255329ddd5670a96ef5e2cb0e3e3c37f34dac3f81b
3
+ size 1917188384
evil-alpaca-right-lean-l3.2-3b-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33bcdfbfe4549a2678ea8f62499ea0f4fc3e98173aa1c88ed568248b3f586e06
3
+ size 1829108000
evil-alpaca-right-lean-l3.2-3b-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e164b034b22e9da3aa53c9a89b945ef131485e6e5aebee3fd7085cff53e6738
3
+ size 1363933472
evil-alpaca-right-lean-l3.2-3b-i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72eedc4899f197b57af6c2915a4c7db10f8d3dbe2e6fdb92874602e6bb4da5c1
3
+ size 1274280224
evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebc4e257be270d4c3f3beb1fcb8f65ab032deaee4ba888eda79712ef0049cbd9
3
+ size 1815345440
evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cba7223bf5e231ea26d75bd689fc71266b71bd0e4684c77041936dd88e38a377
3
+ size 1687157024
evil-alpaca-right-lean-l3.2-3b-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d8a04408f65ee01b8759d78c9a5ff7d1c8c196d9f0184a76ebf330173bc1167
3
+ size 1542846752
evil-alpaca-right-lean-l3.2-3b-i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45681ddc91f75bd4cec578f4f79f612591928dc63d2f44c310b16b8104fe9fb6
3
+ size 1921906976
evil-alpaca-right-lean-l3.2-3b-i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42b1a05d7540c494d2c5e2f7eacaa28d2240d344648742a288165fd46374bcc2
3
+ size 2093349152
evil-alpaca-right-lean-l3.2-3b-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc057fbd79f3a25933ee6f0237fe1889346436fb770953f12838fe06c4467210
3
+ size 2019375392
evil-alpaca-right-lean-l3.2-3b-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f64203f2c1de67e26cb01b3f876960195ccdc1487682ddc7d60ae4028c53297b
3
+ size 1928198432
evil-alpaca-right-lean-l3.2-3b-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa8f83509f6bc7c405f2273a72b4793dfb6410f7cb2f7ed70539144c4c377f66
3
+ size 2322151712
evil-alpaca-right-lean-l3.2-3b-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70f35e681bdb04c1bedc025cef669131002a0b720de3307e8e5a9c0838c317fe
3
+ size 2269509920
evil-alpaca-right-lean-l3.2-3b-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e08fc80f840cbc3fce81d0cbe35d026a2ed53426258639dfce94f1fabc995e6
3
+ size 2643851552