Update README.md
Browse files
README.md
CHANGED
@@ -250,10 +250,10 @@ Ser Davos pointed across the calm blue waters of the bay. “Yonder.” Tyrion l
|
|
250 |
## LLAMA-3_8B_Unaligned_BETA is available at the following quantizations:
|
251 |
|
252 |
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA)
|
253 |
-
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_GGUFs) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_iMatrix)
|
254 |
- EXL2: [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-3.5-bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-4.0-bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-5.0-bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-6.0-bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-7.0-bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-8.0-bpw)
|
255 |
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_FP8)
|
256 |
-
- Mobile (ARM): [
|
257 |
|
258 |
|
259 |
|
|
|
250 |
## LLAMA-3_8B_Unaligned_BETA is available at the following quantizations:
|
251 |
|
252 |
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA)
|
253 |
+
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_GGUFs) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_iMatrix) | [High-Attention](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_GGUF_HA) | [iMatrix-High-Attention](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_HA_NL)
|
254 |
- EXL2: [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-3.5-bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-4.0-bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-5.0-bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-6.0-bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-7.0-bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-8.0-bpw)
|
255 |
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_FP8)
|
256 |
+
- Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_ARM) | [Q4_0_High-Attention](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_ARM_HA)
|
257 |
|
258 |
|
259 |
|