Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

12,658

Full-text search

Active filters: imatrix

bartowski/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 2.7k • 2

mradermacher/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-i1-GGUF

Updated Sep 19, 2024 • 818 • 2

DavidAU/Mistral-Small-Instruct-2409-22B-NEO-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 1.6k • 7

v000000/L3.1-Niitorm-8B-DPO-t0.0001-GGUFs-IMATRIX

Updated Oct 6, 2024 • 99 • 4

mradermacher/L3.1-Niitorm-8B-DPO-t0.0001-i1-GGUF

Updated Sep 20, 2024 • 529 • 3

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22, 2024 • 14.6k • 41

mradermacher/Acolyte-22B-i1-GGUF

Updated Sep 23, 2024 • 458 • 2

bartowski/Llama-3_1-Nemotron-51B-Instruct-GGUF

Text Generation • Updated Jan 1 • 5.08k • 6

mradermacher/Spartan_v2.0-i1-GGUF

Updated Sep 25, 2024 • 114 • 1

mradermacher/2B-ad-i1-GGUF

Updated Jan 26 • 94 • 1

mradermacher/Qwen2.5-1.5B-Instruct-i1-GGUF

Updated Oct 10, 2024 • 271 • 1

mradermacher/Qwen2.5-32B-AGI-i1-GGUF

Updated Sep 26, 2024 • 649 • 1

mradermacher/Qwen2.5-14B-i1-GGUF

Updated Oct 10, 2024 • 318 • 2

mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF

Updated Sep 26, 2024 • 1.61k • 7

DavidAU/Llama-3.2-3B-Instruct-NEO-SI-FI-GGUF

Text Generation • Updated Nov 14, 2024 • 952 • 6

mradermacher/PowerMoE-3b-i1-GGUF

Updated Feb 6 • 75 • 1

mradermacher/Gemma-The-Writer-9B-i1-GGUF

Updated Sep 27, 2024 • 1.19k • 4

alfredplpl/llm-jp-3-3.7b-instruct-gguf

Updated Oct 3, 2024 • 185 • 8

alfredplpl/llm-jp-3-13b-instruct-gguf

Updated Oct 3, 2024 • 205 • 7

mradermacher/Llama-3.2-3B-Instruct-uncensored-i1-GGUF

Updated Sep 28, 2024 • 3.66k • 7

Lewdiculous/Violet_Twilight-v0.2-GGUF-IQ-Imatrix

Updated Nov 13, 2024 • 2.25k • 16

bartowski/CalmeRys-78B-Orpo-v0.1-GGUF

Text Generation • Updated Sep 30, 2024 • 726 • 7

mradermacher/Lyra4-Gutenberg2-12B-i1-GGUF

Updated Oct 11, 2024 • 629 • 4

alfredplpl/gemma-2-2b-jpn-it-gguf

Updated Dec 18, 2024 • 905 • 19

alfredplpl/gemma-2-baku-2b-it-gguf

Updated Dec 18, 2024 • 325 • 9

bartowski/Llama-3.1-WhiteRabbitNeo-2-70B-GGUF

Text Generation • Updated Oct 5, 2024 • 516 • 4

mradermacher/Llama-3.2-1B-Instruct-Uncensored-i1-GGUF

Updated Oct 11, 2024 • 747 • 5

mradermacher/rombos_Replete-Coder-Llama3-8B-i1-GGUF

Updated Oct 11, 2024 • 2.08k • 1

mradermacher/Rombos-LLM-V2.5-Qwen-32b-i1-GGUF

Updated Oct 11, 2024 • 702 • 2

webbigdata/gemma-2-2b-jpn-it-translate-gguf

Updated Oct 22, 2024 • 6.17k • 6