SicariusSicariiStuff
/

Impish_QWEN_7B-1M

Model card Files Files and versions Community

SicariusSicariiStuff commited on 19 days ago

Commit

d7dd349

·

verified ·

1 Parent(s): 4f54c37

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -38,10 +38,10 @@ But she's just extending the pain.
 ## Impish_QWEN_7B-1M is available at the following quantizations:
 - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M)
-- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_iMatrix)
 - EXL2: [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-8.0bpw)
 - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_FP8)
-- Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_ARM)
 ---

 ## Impish_QWEN_7B-1M is available at the following quantizations:
 - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M)
+- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_iMatrix) | [High-Attention](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_GGUF_HA) | [iMatrix-High-Attention](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_HA_NL)
 - EXL2: [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M-8.0bpw)
 - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_FP8)
+- Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_ARM) | [Q4_0_High-Attention](https://huggingface.co/SicariusSicariiStuff/Impish_QWEN_7B-1M_ARM_HA)
 ---