Hugging Face's logo

RichardErkhov
/
google_-_shieldgemma-9b-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
RichardErkhov commited on
Commit
06f4491
·
verified ·
1 Parent(s): f2cb572

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -27,11 +27,11 @@ shieldgemma-9b - GGUF
27
  | [shieldgemma-9b.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.IQ4_NL.gguf) | IQ4_NL | 5.1GB |
28
  | [shieldgemma-9b.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_K_S.gguf) | Q4_K_S | 5.1GB |
29
  | [shieldgemma-9b.Q4_K.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_K.gguf) | Q4_K | 5.37GB |
30
- | [shieldgemma-9b.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_K_M.gguf) | Q4_K_M | 5.37GB |
31
  | [shieldgemma-9b.Q4_1.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_1.gguf) | Q4_1 | 5.55GB |
32
  | [shieldgemma-9b.Q5_0.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_0.gguf) | Q5_0 | 6.04GB |
33
  | [shieldgemma-9b.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_K_S.gguf) | Q5_K_S | 6.04GB |
34
- | [shieldgemma-9b.Q5_K.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_K.gguf) | Q5_K | 6.19GB |
35
  | [shieldgemma-9b.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_K_M.gguf) | Q5_K_M | 6.19GB |
36
  | [shieldgemma-9b.Q5_1.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_1.gguf) | Q5_1 | 6.52GB |
37
  | [shieldgemma-9b.Q6_K.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q6_K.gguf) | Q6_K | 7.07GB |
 
27
  | [shieldgemma-9b.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.IQ4_NL.gguf) | IQ4_NL | 5.1GB |
28
  | [shieldgemma-9b.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_K_S.gguf) | Q4_K_S | 5.1GB |
29
  | [shieldgemma-9b.Q4_K.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_K.gguf) | Q4_K | 5.37GB |
30
+ | [shieldgemma-9b.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_K_M.gguf) | Q4_K_M | 2.87GB |
31
  | [shieldgemma-9b.Q4_1.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q4_1.gguf) | Q4_1 | 5.55GB |
32
  | [shieldgemma-9b.Q5_0.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_0.gguf) | Q5_0 | 6.04GB |
33
  | [shieldgemma-9b.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_K_S.gguf) | Q5_K_S | 6.04GB |
34
+ | [shieldgemma-9b.Q5_K.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_K.gguf) | Q5_K | 3.81GB |
35
  | [shieldgemma-9b.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_K_M.gguf) | Q5_K_M | 6.19GB |
36
  | [shieldgemma-9b.Q5_1.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q5_1.gguf) | Q5_1 | 6.52GB |
37
  | [shieldgemma-9b.Q6_K.gguf](https://huggingface.co/RichardErkhov/google_-_shieldgemma-9b-gguf/blob/main/shieldgemma-9b.Q6_K.gguf) | Q6_K | 7.07GB |