numen-tech's picture
Add weights
e16acfd
metadata
license: gemma
base_model: ifable/gemma-2-Ifable-9B
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit OmniQuant quantized version of gemma-2-Ifable-9B for inference with the Private LLM app. This model is currently ranked second on the Creative Writing Benchmark (on January 28th, 2025).