Hugging Face's logo

vislupus
/
bulgarian-joke-master-Qwen2.5-0.5B-Instruct-bnb-4bit-gguf

Transformers
GGUF
English
qwen2
text-generation-inference
unsloth
Inference Endpoints
conversational
Model card Files Community

Uploaded model

  • Developed by: vislupus
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
11
GGUF
Model size
494M params
Architecture
qwen2

4-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for vislupus/bulgarian-joke-master-Qwen2.5-0.5B-Instruct-bnb-4bit-gguf

Base model

Qwen/Qwen2.5-0.5B
Finetuned
Qwen/Qwen2.5-0.5B-Instruct
Quantized
unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit
Quantized
(6)
this model

Collection including vislupus/bulgarian-joke-master-Qwen2.5-0.5B-Instruct-bnb-4bit-gguf