phi-4-gguf / README.md
doberst's picture
Upload 3 files
18d6e0d verified
---
license: apache-2.0
inference: false
base_model: microsoft/phi-4
base_model_relation: quantized
tags: [green, llmware-chat, p14, gguf]
---
# phi-4-gguf
<!-- Provide a quick summary of what the model is/does. -->
**phi-4-gguf** is a GGUF Q4_K_M quantized version of [Microsoft Phi-4](https://www.huggingface.co/microsoft/phi-4), providing a fast, small inference implementation, optimized for AI PCs.
### Model Description
- **Developed by:** Microsoft
- **Quantized by:** bartowksi
- **Model type:** phi4
- **Parameters:** 14.7 billion
- **Model Parent:** microsoft/phi-4
- **Language(s) (NLP):** English
- **License:** Apache 2.0
- **Uses:** Chat, general-purpose LLM
- **Quantization:** int4
## Model Card Contact
[llmware on hf](https://www.huggingface.co/llmware)
[llmware website](https://www.llmware.ai)