Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

23,022

Full-text search

Active filters: 4-bit

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25, 2024 • 987k • 27

mlx-community/Llama-3.2-1B-Instruct-4bit

Text Generation • Updated Oct 7, 2024 • 3.34M • 12

unsloth/Llama-3.2-3B-bnb-4bit

Text Generation • Updated 8 days ago • 40k • 10

unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 3.72k • 2

unsloth/Qwen2.5-Coder-14B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.41k • 2

unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 55.9k • 19

mlx-community/phi-4-4bit

Text Generation • Updated 18 days ago • 635k • 17

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v3

Text Generation • Updated Dec 20, 2024 • 622 • 14

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 7 days ago • 4.23k • 13

unsloth/phi-4-bnb-4bit

Text Generation • Updated 17 days ago • 3.54k • 12

mlx-community/jinaai-ReaderLM-v2

Updated 13 days ago • 131 • 14

unsloth/DeepSeek-R1-Distill-Qwen-7B-bnb-4bit

Text Generation • Updated 9 days ago • 1.04k • 2

casperhansen/deepseek-r1-distill-qwen-14b-awq

Updated 11 days ago • 2.32k • 5

mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit

Updated 11 days ago • 12.2k • 5

mlx-community/DeepSeek-R1-Distill-Qwen-14B-4bit

Updated 10 days ago • 6.19k • 4

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 10 days ago • 7.53k • 7

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated 10 days ago • 3.38k • 4

srinivasbilla/llasa-3b-Q4-mlx

Updated 10 days ago • 47 • 2

unsloth/Llama-3.2-1B-unsloth-bnb-4bit

Updated 9 days ago • 3 • 2

cogear/DeepSeek-R1-Distill-Qwen-32B-Q4-mlx

Text Generation • Updated 8 days ago • 62 • 2

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2

Text Generation • Updated 7 days ago • 181 • 4

Valdemardi/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-AWQ

Text Generation • Updated 7 days ago • 566 • 2

hentograf/deepseek-r1-qwen-2.5-32B-ablated-Q4-mlx

Text Generation • Updated 6 days ago • 75 • 2

nicoboss/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Lora

Updated 5 days ago • 12 • 2

mlx-community/meditron-7b

Updated 5 days ago • 22 • 2

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_4.0bpw_H8

Text Generation • Updated 5 days ago • 67 • 2

wnma3mz/Janus-Pro-7B-LM-4bit

Text Generation • Updated about 22 hours ago • 83 • 2

jarvisvasu/Qwen2.5-VL-3B-Instruct-4bit

Image-Text-to-Text • Updated 1 day ago • 37 • 2

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated about 10 hours ago • 2

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 48 • 219