Edit Models filters

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

12,449

Full-text search

Active filters: gguf-my-repo

ozone-ai/0x-lite-Q4_K_M-GGUF

Updated 6 days ago • 163 • 15

AtlaAI/Selene-1-Mini-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated about 17 hours ago • 114 • 7

sm54/FuseO1-DeepSeekR1-QwQ-SkyT1-Flash-32B-Preview-Q4_K_M-GGUF

Updated 7 days ago • 637 • 6

Aryanne/YuE-s1-7B-anneal-en-cot-Q6_K-GGUF

Text Generation • Updated 3 days ago • 138 • 5

AtlaAI/Selene-1-Mini-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated about 17 hours ago • 81 • 5

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • Updated Oct 28, 2024 • 1.27k • 6

G17c21ds/Qwen2.5-14B-Instruct-Uncensored-Q8_0-GGUF

Updated Dec 13, 2024 • 143 • 5

prithivMLmods/GWQ-9B-Preview2-Q8_0-GGUF

Text Generation • Updated 23 days ago • 115 • 7

prithivMLmods/GWQ-9B-Preview-Q6_K-GGUF

Text Generation • Updated 23 days ago • 30 • 7

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_S-GGUF

Updated 2 days ago • 380 • 3

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated 1 day ago • 23 • 3

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 480k • 25

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • Updated Nov 26, 2024 • 1.17k • 3

aovchinnikov/T-lite-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 123 • 4

ngxson/MiniThinky-v2-1B-Llama-3.2-Q8_0-GGUF

Updated 23 days ago • 291 • 7

prithivMLmods/GWQ-9B-Preview2-Q6_K-GGUF

Text Generation • Updated 23 days ago • 37 • 7

prithivMLmods/GWQ-9B-Preview2-Q5_K_M-GGUF

Text Generation • Updated 23 days ago • 65 • 7

prithivMLmods/GWQ-9B-Preview-Q5_K_M-GGUF

Text Generation • Updated 23 days ago • 39 • 7

prithivMLmods/GWQ-9B-Preview-Q8_0-GGUF

Text Generation • Updated 23 days ago • 71 • 7

nanowell/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF

Updated 11 days ago • 617 • 2

ggml-org/DeepSeek-R1-Distill-Qwen-1.5B-Q4_0-GGUF

Updated 10 days ago • 2.48k • 2

ggml-org/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF

Updated 10 days ago • 3k • 4

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated 9 days ago • 36 • 2

harkov000/R1-DarkIdol-8B-v0.4-Q6_K-GGUF

Updated 7 days ago • 88 • 2

G17c21ds/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q8_0-GGUF

Updated 5 days ago • 3.41k • 2

lilyanatia/DeepSeek-R1-Distill-Llama-8B-abliterated-Q4_0-GGUF

Updated 4 days ago • 715 • 2

multimodalart/YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

Text Generation • Updated 3 days ago • 115 • 2

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated about 13 hours ago • 2

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated about 13 hours ago • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated about 6 hours ago • 2