unsloth/phi-4-unsloth-bnb-4bit
Text Generation
•
Updated
•
56.1k
•
38
Unsloth 4-bit Dynamic Quants
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
-
-
unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit
Text Generation • Updated • 15.9k • 9 -
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 55.9k • 19 -
unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit
Updated • 630 • 1 -
unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 22.9k • 9 -
unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 15.6k • 5 -
unsloth/Pixtral-12B-2409-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 3.23k • 4 -
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 347 • 1 -
unsloth/QwQ-32B-Preview-unsloth-bnb-4bit
Text Generation • Updated • 978 • 18 -
unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit
Text Generation • Updated • 5.18k • 2 -
unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit
Text Generation • Updated • 6.62k • 9 -
unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 1.06k • 3