Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

13,595

Full-text search

Active filters: imatrix

lmstudio-community/AlchemistCoder-L-7B-GGUF

Text Generation • Updated May 31, 2024 • 122 • 3

legraphista/K2-Chat-IMat-GGUF

Text Generation • Updated May 31, 2024 • 2.1k • 5

DavidAU/Fimbulvetr-11B-Ultra-Quality-plus-imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 118 • 12

mradermacher/Maixtchup-4x7b-i1-GGUF

Updated Aug 2, 2024 • 33

DavidAU/Psyonic-Cetacean-EXP

Text Generation • Updated Nov 14, 2024 • 63 • 1

mradermacher/llama-3-spicy-abliterated-stella-8B-i1-GGUF

Updated Aug 2, 2024 • 272 • 2

mradermacher/dolphin-2.9.2-mixtral-8x22b-i1-GGUF

Updated Aug 2, 2024 • 142 • 4

mradermacher/Poppy_Porpoise-1.30-L3-8B-i1-GGUF

Updated Feb 3 • 65 • 2

mradermacher/Llama-3-22B-Instruct-v0.1-i1-GGUF

Updated Aug 2, 2024 • 29

legraphista/K2-IMat-GGUF

Text Generation • Updated May 31, 2024 • 823 • 3

mradermacher/Meta-Llama-3-70B-Instruct-abliterated-v3.5-i1-GGUF

Updated Aug 2, 2024 • 527 • 3

legraphista/neo_7b_instruct_v0.1-IMat-GGUF

Text Generation • Updated May 31, 2024 • 1.1k

mradermacher/IceCaffeLatteRP-7b-i1-GGUF

Updated Aug 2, 2024 • 28

legraphista/neo_7b_sft_v0.1-IMat-GGUF

Text Generation • Updated May 31, 2024 • 576

duyntnet/Hermes-2-Pro-Llama-3-8B-imatrix-GGUF

Text Generation • Updated May 31, 2024 • 89

mradermacher/IceMochaccinoRP-7b-i1-GGUF

Updated Aug 2, 2024 • 29

legraphista/neo_7b-IMat-GGUF

Text Generation • Updated May 31, 2024 • 183

MarsupialAI/Moist-Miqu-70B-v1_iMatrix_GGUF

Updated Jun 1, 2024 • 484 • 2

legraphista/Llama-3-8B-Instruct-MopeyMule-IMat-GGUF

Text Generation • Updated May 31, 2024 • 726 • 1

mradermacher/Silver-Sun-v2-11B-i1-GGUF

Updated Aug 2, 2024 • 30

SixOpen/Nous-Capybara-7B-V1.9-IQ4_NL-GGUF

Updated May 31, 2024 • 8

mradermacher/Poppy_Porpoise-1.0-L3-8B-i1-GGUF

Updated Feb 3 • 298 • 2

hermes42/WizardLM-2-8x22B-imatrix-GGUF

Updated Jun 1, 2024 • 284

mradermacher/Ursidae-11b-Mini-i1-GGUF

Updated Dec 16, 2024 • 356

bartowski/AutoCoder-GGUF

Text Generation • Updated May 31, 2024 • 137 • 7

backyardai/c4ai-command-r-plus-GGUF

Updated Jun 1, 2024 • 373 • 1

legraphista/Meta-Llama-3-8B-Instruct-abliterated-v3-IMat-GGUF

Text Generation • Updated Jun 1, 2024 • 1.21k • 1

mradermacher/L3-daybreak-TheSpice-8b-v0.1.3-i1-GGUF

Updated Aug 2, 2024 • 36 • 3

mradermacher/archangel_sft-kto_llama30b-i1-GGUF

Updated Aug 2, 2024 • 432

legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF

Text Generation • Updated Jun 1, 2024 • 7.07k • 2