Edit Models filters

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

13,262

Full-text search

Active filters: llama-cpp

ozone-ai/0x-lite-Q4_K_M-GGUF

Updated 6 days ago • 163 • 15

AtlaAI/Selene-1-Mini-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated about 16 hours ago • 114 • 7

sm54/FuseO1-DeepSeekR1-QwQ-SkyT1-Flash-32B-Preview-Q4_K_M-GGUF

Updated 7 days ago • 637 • 6

Aryanne/YuE-s1-7B-anneal-en-cot-Q6_K-GGUF

Text Generation • Updated 3 days ago • 138 • 5

AtlaAI/Selene-1-Mini-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated about 16 hours ago • 81 • 5

IntelligentEstate/Die_Walkure-R1-Distill-Llama-8B-iQ4_K_M-GGUF

Updated 4 days ago • 246 • 4

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • Updated Oct 28, 2024 • 1.27k • 6

G17c21ds/Qwen2.5-14B-Instruct-Uncensored-Q8_0-GGUF

Updated Dec 13, 2024 • 143 • 5

prithivMLmods/GWQ-9B-Preview2-Q8_0-GGUF

Text Generation • Updated 23 days ago • 115 • 7

prithivMLmods/GWQ-9B-Preview-Q6_K-GGUF

Text Generation • Updated 23 days ago • 30 • 7

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_S-GGUF

Updated 2 days ago • 380 • 3

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated 1 day ago • 23 • 3

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 480k • 25

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • Updated Nov 26, 2024 • 1.17k • 3

aovchinnikov/T-lite-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 123 • 4

prithivMLmods/GWQ-9B-Preview2-GGUF

Text Generation • Updated 23 days ago • 97 • 7

ngxson/MiniThinky-v2-1B-Llama-3.2-Q8_0-GGUF

Updated 23 days ago • 291 • 7

prithivMLmods/GWQ-9B-Preview2-Q6_K-GGUF

Text Generation • Updated 23 days ago • 37 • 7

prithivMLmods/GWQ-9B-Preview2-Q5_K_M-GGUF

Text Generation • Updated 23 days ago • 65 • 7

prithivMLmods/GWQ-9B-Preview-Q5_K_M-GGUF

Text Generation • Updated 23 days ago • 39 • 7

prithivMLmods/GWQ-9B-Preview-Q8_0-GGUF

Text Generation • Updated 23 days ago • 71 • 7

ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

Updated 23 days ago • 104 • 3

ggml-org/LoRA-Qwen2.5-32B-Instruct-abliterated-F16-GGUF

Updated 21 days ago • 184 • 2

nanowell/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF

Updated 11 days ago • 617 • 2

ggml-org/DeepSeek-R1-Distill-Qwen-1.5B-Q4_0-GGUF

Updated 10 days ago • 2.48k • 2

ggml-org/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF

Updated 10 days ago • 3k • 4

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated 8 days ago • 36 • 2

ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

Updated 7 days ago • 40 • 2

harkov000/R1-DarkIdol-8B-v0.4-Q6_K-GGUF

Updated 7 days ago • 88 • 2

G17c21ds/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q8_0-GGUF

Updated 5 days ago • 3.41k • 2