Hugging Face's logo

SicariusSicariiStuff
/
Impish_LLAMA_4B

Safetensors
English
llama
Model card Files Community
2
SicariusSicariiStuff commited on
Commit
e51e975
·
verified ·
1 Parent(s): 47f1fd5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -146,7 +146,7 @@ $Scenario:
146
  ## Impish_LLAMA_4B is available at the following quantizations:
147
 
148
  - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B)
149
- - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_GGUF)
150
  - GPTQ: [4-Bit-32](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_GPTQ_4-bit-32) | [4-Bit-128](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_GPTQ_4-bit-128)
151
  - EXL3: [2.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_2.0bpw) | [2.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_2.5bpw) | [3.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_3.0bpw) | [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_3.5bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_4.0bpw) | [4.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_4.5bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_5.0bpw) | [5.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_5.5bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_6.0bpw) | [6.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_6.5bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_7.0bpw) | [7.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_7.5bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_8.0bpw)
152
  - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_FP8)
 
146
  ## Impish_LLAMA_4B is available at the following quantizations:
147
 
148
  - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B)
149
+ - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_GGUF) | [iMatrix](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_iMatrix) | [High-Attention](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_GGUF_HA) | [iMatrix-High-Attention](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_HA_NL)
150
  - GPTQ: [4-Bit-32](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_GPTQ_4-bit-32) | [4-Bit-128](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_GPTQ_4-bit-128)
151
  - EXL3: [2.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_2.0bpw) | [2.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_2.5bpw) | [3.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_3.0bpw) | [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_3.5bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_4.0bpw) | [4.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_4.5bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_5.0bpw) | [5.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_5.5bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_6.0bpw) | [6.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_6.5bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_7.0bpw) | [7.5 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_7.5bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_8.0bpw)
152
  - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_4B_FP8)