Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

12,620

Full-text search

Active filters: imatrix

qwp4w3hyb/Codestral-22B-v0.1-iMat-GGUF

Text Generation • Updated Jun 1, 2024 • 340 • 3

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2, 2024 • 2.01k • 24

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Feb 2 • 16.2k • 150

Qwen/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 17, 2024 • 633 • 31

Lewdiculous/Hathor-L3-8B-v.01-GGUF-IQ-Imatrix

Updated Jun 7, 2024 • 131 • 8

mradermacher/Llama-3-Luminurse-v0.2-OAS-8B-i1-GGUF

Updated Feb 7 • 1.26k • 1

mradermacher/Writing_Partner_Mistral_7B-i1-GGUF

Updated Aug 2, 2024 • 72 • 1

Lewdiculous/llama3-8B-aifeifei-1.3-GGUF-IQ-Imatrix

Updated Jun 12, 2024 • 2.39k • 4

bartowski/L3-70B-Euryale-v2.1-GGUF

Text Generation • Updated Jun 13, 2024 • 333 • 15

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imat-plus2

Text Generation • Updated Nov 14, 2024 • 3.65k • 7

mradermacher/Hathor_RP-v.01-L3-8B-i1-GGUF

Updated Dec 16, 2024 • 442 • 3

mradermacher/Eurstoria-106B-i1-GGUF

Updated 8 days ago • 252 • 1

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 60.5k • 100

CISCai/DeepSeek-Coder-V2-Lite-Instruct-SOTA-GGUF

Updated Jun 17, 2024 • 609 • 2

mradermacher/DeepSeek-Coder-V2-Lite-Base-i1-GGUF

Updated Aug 2, 2024 • 298 • 2

mradermacher/SuperQwen2-7B-Chat-i1-GGUF

Updated Aug 2, 2024 • 209 • 1

mradermacher/Tess-v2.5-Phi-3-medium-128k-14B-i1-GGUF

Updated 21 days ago • 566 • 3

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 2.3M • 16

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 1.5k • 5

bartowski/DeepSeek-Coder-V2-Instruct-GGUF

Text Generation • Updated Jun 23, 2024 • 1.16k • 31

legraphista/RoLlama3-8b-Instruct-IMat-GGUF

Text Generation • Updated Jun 23, 2024 • 1.06k • 3

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 3.05k • 17

mradermacher/Hathor_Fractionate-L3-8B-v.05-i1-GGUF

Updated Feb 5 • 276 • 1

mradermacher/Qwen2-7B-Multilingual-RP-i1-GGUF

Updated Aug 2, 2024 • 1.07k • 2

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 3.65k • 1

Undi95/MG-FinalMix-72B-GGUF

Updated Jun 26, 2024 • 20 • 2

mradermacher/Chocolatine-8B-Instruct-DPO-v1.0-i1-GGUF

Updated Feb 3 • 276 • 1

bartowski/L3-Aethora-15B-V2-GGUF

Text Generation • Updated Jun 27, 2024 • 276 • 5

mradermacher/Llama-3-Mopeyfied-Psychology-v2-i1-GGUF

Updated Feb 7 • 2.27k • 1

mradermacher/Llama-3-LewdPlay-8B-evo-i1-GGUF

Updated Aug 2, 2024 • 686 • 1