Hugging Face's logo

mradermacher
/
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-i1-GGUF

Transformers
GGUF
English
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
486b519
·
verified ·
1 Parent(s): 1b5457c

uploaded from rich1

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ1_M.gguf +3 -0
  3. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ1_S.gguf +3 -0
  4. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_M.gguf +3 -0
  5. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_S.gguf +3 -0
  6. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_XS.gguf +3 -0
  7. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf +3 -0
  8. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_M.gguf +3 -0
  9. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_S.gguf +3 -0
  10. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_XS.gguf +3 -0
  11. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf +3 -0
  12. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ4_NL.gguf +3 -0
  13. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ4_XS.gguf +3 -0
  14. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q2_K.gguf +3 -0
  15. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q2_K_S.gguf +3 -0
  16. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_L.gguf +3 -0
  17. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_M.gguf +3 -0
  18. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_S.gguf +3 -0
  19. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_0.gguf +3 -0
  20. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_1.gguf +3 -0
  21. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_K_M.gguf +3 -0
  22. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_K_S.gguf +3 -0
  23. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q5_K_M.gguf +3 -0
  24. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q5_K_S.gguf +3 -0
  25. Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4c0b84d62099c30cfb689cdb3d8dd3c6f54031c7915a7f2c252fddb897e441b
3
+ size 394552448
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:524b9b9e7609132dd02399d720e2cde67e89a3692622bc0f9267fe156a0230e9
3
+ size 392407424
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55076f55274e37a941cf4a16ad919688df40dadab8ec88258296b036c0fdf365
3
+ size 405175424
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04460e3d94c6d34ba21f8e45efeb25ebecb91c6da9908995337e2dff16bf1327
3
+ size 402315392
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0e0d497ca0c7ed15af82a93f23769873428deb5846bb2bb67c22543a45da1b3
3
+ size 400987520
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ef3568cdc8f595dc54c8217381d86ee0063ace38e175179175a452af203f411
3
+ size 398127488
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d96b6fef7a8203aa31e162a8b933bb6097df8f00c0708b9baff58adc17b0fbed
3
+ size 419330432
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f69d249c36b6de2fbbbc2ba1a33765f6ba3dffc6362a7684aef71883a651a35a
3
+ size 415185536
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42ba760f0995fac61a40d40d993faf1a0cad2f8b88fd52403a4ca42366ff6c96
3
+ size 415185536
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab9b02e0a8504bf9879c957ef2d014da174a573ca79083d1c53a651b2803f2f8
3
+ size 410282624
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f65755581dc07af6d605c851209ae073f4a783fc10c7d1354de42f4dc7c767b
3
+ size 429249152
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:611b769af94b4d084993437ffbe99a469313183cc2968d5348aa6c5a43c50c3b
3
+ size 425980544
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff862ae4ecf40688c18a4316a0fcc78a082479124f45baa3e5dba6ad2a470d95
3
+ size 415185536
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58fe04b881b46094ca0700bf915fa69ae148d2530117b5894da378acb63f8253
3
+ size 407626880
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42445d1ad9fa78efdae52bf80efe4184c72ad0509a222ec870f9cc9c8bb2a411
3
+ size 445936256
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3466b0ac1761f50c7a1ad7d687ac662c3d01a678d350e96b6a4defc3379caafd
3
+ size 432044672
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8fa0e51839193deaf7d5878ed2fb1e7dada4bd9b4dc3ed4aa1feedf7ca63aca2
3
+ size 414841472
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66fc240d4d6cf3ca7de01a712df70f96e85aa4526f71024a7ebb7100d9a570a4
3
+ size 429550208
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d46ae2c2d3875932ac4976e6bc3d6b5bfa0227022b32c7585199c8f54ad9d79
3
+ size 459605632
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4a39b8238709668a05fc67ed09dde522085b36a606b5b98e17ef884ad246c88
3
+ size 491402880
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42a7c0969528a6acdc7c742ba2a7d9ddb49bc5fa9f89458fee31f0b5533fa367
3
+ size 479066752
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a19f8c16ac539303478a174f89c1db0b5bb1e487757b1b1b3f0b5fbe93843740
3
+ size 522189440
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4153baec0e2f16df9e477a1eaee5112e73f989a538f86796572eabc36ee0409a
3
+ size 514813568
Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5641f25e58c314e30fbdeb52b0bdc7848d8d106b05d12b8f00fe7c055ac5a9d4
3
+ size 650381952