Text Generation
GGUF
English
Qwen2.5-Coder-3B
Inference Endpoints
conversational
Hammer2.1-3b-GGUF / README.md
Melvin56's picture
Update README.md
4e1848c verified
metadata
license: other
license_name: qwen-research
license_link: https://huggingface.co/MadeAgents/Hammer2.1-3b/blob/main/LICENSE
datasets:
  - Salesforce/xlam-function-calling-60k
  - MadeAgents/xlam-irrelevance-7.5k
base_model:
  - MadeAgents/Hammer2.1-3b
language:
  - en
pipeline_tag: text-generation
tags:
  - Qwen2.5-Coder-3B

Melvin56/Hammer2.1-3b-GGUF

Original Model : MadeAgents/Hammer2.1-3b

All quants are made using the imatrix option.

Model Size (GB)
Q2_K_S 1.19
Q2_K 1.27
Q3_K_M 1.60
Q3_K_M 1.60
Q4_0 1.83
Q4_K_M 1.92
Q5_K_M 2.22
Q6_K 2.53
Q8_0 3.28
F16 6.17