Update README.md
Browse files
README.md
CHANGED
|
@@ -30,19 +30,19 @@ Recommended settings are here: [**Settings**](https://huggingface.co/VongolaChou
|
|
| 30 |
## Download a file (not the whole branch) from below:
|
| 31 |
| Filename | Quant type | File Size | Split | Description |
|
| 32 |
| -------- | ---------- | --------- | ----- | ----------- |
|
| 33 |
-
| [Starcannon-Unleashed-12B-v1.0-FP16.gguf](https://huggingface.co/VongolaChouko/Starcannon-Unleashed-12B-v1.0-GGUF/blob/main/Starcannon-Unleashed-12B-v1.0-FP16.gguf) |
|
| 34 |
-
| [
|
| 35 |
| [Starcannon-Unleashed-12B-v1.0-Q6_K.gguf](https://huggingface.co/VongolaChouko/Starcannon-Unleashed-12B-v1.0-GGUF/blob/main/Starcannon-Unleashed-12B-v1.0-Q6_K.gguf) | Q6_K | 10.06GB | false | Very high quality, near perfect, *recommended*. |
|
| 36 |
-
| [
|
| 37 |
-
| [
|
| 38 |
-
| [
|
| 39 |
-
| [
|
| 40 |
-
| [
|
| 41 |
-
| [
|
| 42 |
-
| [
|
| 43 |
-
| [
|
| 44 |
-
| [
|
| 45 |
-
| [
|
| 46 |
|
| 47 |
|
| 48 |
## Instruct
|
|
|
|
| 30 |
## Download a file (not the whole branch) from below:
|
| 31 |
| Filename | Quant type | File Size | Split | Description |
|
| 32 |
| -------- | ---------- | --------- | ----- | ----------- |
|
| 33 |
+
| [Starcannon-Unleashed-12B-v1.0-FP16.gguf](https://huggingface.co/VongolaChouko/Starcannon-Unleashed-12B-v1.0-GGUF/blob/main/Starcannon-Unleashed-12B-v1.0-FP16.gguf) | F16 | 24.50GB | false | Full F16 weights. |
|
| 34 |
+
| [Starcannon-Unleashed-12B-v1.0-Q8_0.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q8_0.gguf) | Q8_0 | 13.02GB | false | Extremely high quality, generally unneeded but max available quant. |
|
| 35 |
| [Starcannon-Unleashed-12B-v1.0-Q6_K.gguf](https://huggingface.co/VongolaChouko/Starcannon-Unleashed-12B-v1.0-GGUF/blob/main/Starcannon-Unleashed-12B-v1.0-Q6_K.gguf) | Q6_K | 10.06GB | false | Very high quality, near perfect, *recommended*. |
|
| 36 |
+
| [Starcannon-Unleashed-12B-v1.0-Q5_K_M.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q5_K_M.gguf) | Q5_K_M | 8.73GB | false | High quality, *recommended*. |
|
| 37 |
+
| [Starcannon-Unleashed-12B-v1.0-Q5_K_S.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q5_K_S.gguf) | Q5_K_S | 8.52GB | false | High quality, *recommended*. |
|
| 38 |
+
| [Starcannon-Unleashed-12B-v1.0-Q4_K_L.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q4_K_L.gguf) | Q4_K_L | 7.98GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
|
| 39 |
+
| [Starcannon-Unleashed-12B-v1.0-Q4_K_M.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q4_K_M.gguf) | Q4_K_M | 7.48GB | false | Good quality, default size for must use cases, *recommended*. |
|
| 40 |
+
| [Starcannon-Unleashed-12B-v1.0-Q4_K_S.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q4_K_S.gguf) | Q4_K_S | 7.12GB | false | Slightly lower quality with more space savings, *recommended*. |
|
| 41 |
+
| [Starcannon-Unleashed-12B-v1.0-Q4_0.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q4_0.gguf) | Q4_0 | 7.09GB | false | Legacy format, generally not worth using over similarly sized formats |
|
| 42 |
+
| [Starcannon-Unleashed-12B-v1.0-Q3_K_L.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q3_K_L.gguf) | Q3_K_L | 6.56GB | false | Lower quality but usable, good for low RAM availability. |
|
| 43 |
+
| [Starcannon-Unleashed-12B-v1.0-Q3_K_M.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q3_K_M.gguf) | Q3_K_M | 6.08GB | false | Low quality. |
|
| 44 |
+
| [Starcannon-Unleashed-12B-v1.0-Q3_K_S.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q3_K_S.gguf) | Q3_K_S | 5.53GB | false | Low quality, not recommended. |
|
| 45 |
+
| [Starcannon-Unleashed-12B-v1.0-Q2_K.gguf](https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/main/Mistral-Nemo-Instruct-2407-Q2_K.gguf) | Q2_K | 4.79GB | false | Very low quality but surprisingly usable. |
|
| 46 |
|
| 47 |
|
| 48 |
## Instruct
|