Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

12,643

Full-text search

Active filters: imatrix

mradermacher/mini-magnum-12b-v1.1-i1-GGUF

Updated Aug 2, 2024 • 364 • 2

mradermacher/Meta-Llama-3.1-70B-i1-GGUF

Updated Dec 16, 2024 • 708 • 2

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • Updated Jul 31, 2024 • 25.9k • 22

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • Updated Jul 31, 2024 • 2.96k • 2

mradermacher/Rude-Assistant-Mistral-Nemo-2407-SFT-i1-GGUF

Updated Jan 22 • 128 • 1

mradermacher/shieldgemma-9b-i1-GGUF

Updated Aug 1, 2024 • 264 • 1

mradermacher/Evolved-Mistral-7B-i1-GGUF

Updated Aug 1, 2024 • 89 • 1

bartowski/Palmyra-Fin-70B-32K-GGUF

Text Generation • Updated Aug 5, 2024 • 631 • 4

Felladrin/gguf-sharded-LaMini-Flan-T5-248M

Text2Text Generation • Updated Aug 5, 2024 • 65 • 1

anthracite-org/magnum-v2-12b-gguf

Text Generation • Updated Aug 22, 2024 • 2.51k • 36

bartowski/Trinity-2-Codestral-22B-GGUF

Text Generation • Updated Aug 8, 2024 • 800 • 8

mradermacher/Mistral-Nemo-Instruct-2407-i1-GGUF

Updated Aug 9, 2024 • 873 • 3

mradermacher/Tess-3-Mistral-Large-2-123B-i1-GGUF

Updated Aug 10, 2024 • 52 • 2

DavidAU/Command-R-01-Ultra-NEO-DARK-HORROR-V1-V2-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 9.42k • 11

mradermacher/Roleplay-Hermes-3-Llama-3.1-8B-i1-GGUF

Updated Aug 16, 2024 • 1.71k • 4

mradermacher/Hermes-3-Llama-3.1-70B-i1-GGUF

Updated Aug 16, 2024 • 217 • 2

mradermacher/Hermes-3-Llama-3.1-8B-i1-GGUF

Updated Aug 16, 2024 • 211 • 3

mradermacher/Rocinante-12B-v1.1-i1-GGUF

Updated Aug 16, 2024 • 2.14k • 4

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 348 • 1

ClaudioItaly/Hermes-3-Llama-3.1-8B-Q5_K_M-GGUF

Updated Aug 16, 2024 • 8 • 1

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 349 • 1

mradermacher/gemma-2-27b-it-SimPO-37K-i1-GGUF

Updated Aug 17, 2024 • 489 • 4

mradermacher/Nemo-12B-Marlin-v7-i1-GGUF

Updated Aug 17, 2024 • 319 • 2

bartowski/Hermes-3-Llama-3.1-405B-GGUF

Text Generation • Updated Sep 27, 2024 • 2.74k • 13

anthracite-org/magnum-v2-123b-gguf

Text Generation • Updated Aug 22, 2024 • 154 • 13

mradermacher/Llama-3.1-8B-Magpie-Align-v0.1-i1-GGUF

Updated Jan 22 • 435 • 1

bartowski/magnum-v2-123b-GGUF

Text Generation • Updated Aug 22, 2024 • 449 • 2

mradermacher/MN-18.5B-Celeste-V1.9-Story-Wizard-ED1-Instruct-i1-GGUF

Updated Aug 23, 2024 • 266 • 1

mradermacher/NemoMix-Unleashed-12B-i1-GGUF

Updated Feb 6 • 2.24k • 12

anthracite-org/magnum-v2-4b-gguf

Text Generation • Updated Aug 27, 2024 • 251 • 7