Text Generation
GGUF
English
Qwen2.5-Coder-0.5B
Inference Endpoints
conversational
Hammer2.1-0.5b-GGUF / README.md
Melvin56's picture
Update README.md
abebcbb verified
---
license: cc-by-nc-4.0
datasets:
- Salesforce/xlam-function-calling-60k
- MadeAgents/xlam-irrelevance-7.5k
base_model:
- MadeAgents/Hammer2.1-0.5b
language:
- en
pipeline_tag: text-generation
tags:
- Qwen2.5-Coder-0.5B
---
# Melvin56/Hammer2.1-0.5b-GGUF
Original Model : [MadeAgents/Hammer2.1-0.5b](https://huggingface.co/MadeAgents/Hammer2.1-0.5b)
All quants are made using the imatrix option.
| Model | Size (GB) |
|:-------------------------------------------------|:-------------:|
| Q2_K_S | 0.32 |
| Q2_K | 0.33 |
| Q3_K_M | 0.35 |
| Q3_K_M | 0.35 |
| Q4_0 | 0.35 |
| Q4_K_M | 0.39 |
| Q5_K_M | 0.41 |
| Q6_K | 0.50 |
| Q8_0 | 0.52 |
| F16 | 0.99 |