---
license: apache-2.0
---

3-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Starling-LM-7B-beta](https://huggingface.co/Nexusflow/Starling-LM-7B-beta).