Update README.md

README.md

@@ -5,4 +5,26 @@ base_model: Isotonic/Mixnueza-6x32M-MoE
 
 GGUF version of [Isotonic/Mixnueza-6x32M-MoE](https://huggingface.co/Isotonic/Mixnueza-6x32M-MoE).
 
-It was not possible to quantize the model after converting it to F16/F32 GGUF, so only those versions are available.
+It was not possible to quantize the model, so only the F16 and F32 GGUF files are available.
+
+## Try it with [llama.cpp](https://github.com/ggerganov/llama.cpp)
+
+```bash
+brew install ggerganov/ggerganov/llama.cpp
+```
+```bash
+llama-cli \
+  --hf-repo Felladrin/gguf-Mixnueza-6x32M-MoE \
+  --model Mixnueza-6x32M-MoE.F32.gguf \
+  --random-prompt  \
+  --dynatemp-range "0.1-2.5" \
+  --top-k 0 \
+  --top-p 1 \
+  --min-p 0.1 \
+  --typical 0.85 \
+  --mirostat 2 \
+  --mirostat-ent 3.5 \
+  --repeat-penalty 1.1 \
+  --repeat-last-n -1 \
+  -n 256
+```