Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

12,643

Full-text search

Active filters: imatrix

grapevine-AI/gemma-2-27b-it-gguf

Updated Oct 26, 2024 • 325 • 13

mradermacher/QuartetAnemoi-70B-t0.0001-i1-GGUF

Updated Aug 2, 2024 • 1.74k • 10

NorwAI/NorwAI-Mistral-7B-instruct

Text Generation • Updated Jul 8, 2024 • 136 • 9

mradermacher/Hathor_Aleph-L3-8B-v0.72-i1-GGUF

Updated Feb 5 • 200 • 1

DavidAU/Psyonic-Cetacean-MythoMax-ED2-Prose-Crazy-Ultra-Quality-29B-GGUF

Text Generation • Updated Nov 22, 2024 • 173 • 2

backyardai/Midnight-Miqu-70B-v1.5-GGUF

Updated Jul 3, 2024 • 1.22k • 5

DavidAU/L3-Stheno-Maid-Blackroot-Grand-HORROR-16B-Ultra-NEO-V2-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 384 • 18

mradermacher/Meta-Llama-3-8B-Instruct-i1-GGUF

Updated Jul 5, 2024 • 1.75k • 2

mradermacher/granite-8b-code-instruct-i1-GGUF

Updated Dec 16, 2024 • 481 • 1

mradermacher/stable-code-instruct-3b-i1-GGUF

Updated Aug 2, 2024 • 240 • 1

THUDM/codegeex4-all-9b-GGUF

Text Generation • Updated Jul 15, 2024 • 1.14k • 12

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14, 2024 • 1.8k • 13

mradermacher/Big-Tiger-Gemma-27B-v1-i1-GGUF

Updated Aug 2, 2024 • 754 • 2

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16, 2024 • 6.73k • 9

nisten/llamagnific-3-87b-gguf

Updated Jul 17, 2024 • 141 • 11

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2, 2024 • 2.42k • 8

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2, 2024 • 2.83k • 7

mradermacher/L3-Intermix-v0.2-i1-GGUF

Updated 21 days ago • 377 • 1

bartowski/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 3.81k • 61

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 2.34M • 17

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 2.33M • 39

mradermacher/NieR-Automata-Chatbot-none-V5-i1-GGUF

Updated 30 days ago • 110 • 1

etemiz/Llama-3.1-405B-Inst-GGUF

Updated Dec 19, 2024 • 148 • 4

lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Jul 25, 2024 • 5.96k • 6

mradermacher/Y1.5-MS-Mysteria-34b-i1-GGUF

Updated Aug 2, 2024 • 393 • 1

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 3.54k • 12

mradermacher/Llama-3.1-Base_NSFW-pretrained_e-0.5-i1-GGUF

Updated Aug 2, 2024 • 255 • 1

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 2.88k • 3

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 681 • 3

mradermacher/Sekhmet_Bet-L3.1-8B-v0.2-i1-GGUF

Updated Feb 5 • 138 • 1