---
license: gemma
base_model: ifable/gemma-2-Ifable-9B
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

---

4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [gemma-2-Ifable-9B](https://huggingface.co/ifable/gemma-2-Ifable-9B) for inference with the [Private LLM](https://privatellm.app) app. This model is currently ranked second on the [Creative Writing Benchmark](https://eqbench.com/creative_writing.html) (on January 28th, 2025).