Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

12,662

Full-text search

Active filters: imatrix

mradermacher/MoE-Girl-1BA-7BT-i1-GGUF

Updated Oct 11, 2024 • 1.5k • 4

bartowski/Behemoth-123B-v1-GGUF

Text Generation • Updated Oct 9, 2024 • 268 • 4

arcee-ai/SuperNova-Medius-GGUF

Updated Oct 17, 2024 • 1.38k • 60

mradermacher/Rombos-LLM-V2.6-Qwen-14b-i1-GGUF

Updated Oct 14, 2024 • 562 • 4

mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF

Updated Oct 14, 2024 • 621 • 2

mradermacher/Astral-Fusion-Neural-Happy-L3.1-8B-i1-GGUF

Updated Oct 14, 2024 • 459 • 3

bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 16, 2024 • 8.65k • 95

XelotX/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 16, 2024 • 402 • 2

mradermacher/Llama-3.1-Nemotron-70B-Instruct-HF-i1-GGUF

Updated Dec 26, 2024 • 1.57k • 5

mradermacher/Mistral-Nemo-Instruct-2407-20b-i1-GGUF

Updated Oct 17, 2024 • 115 • 3

bartowski/magnum-v4-123b-GGUF

Text Generation • Updated Oct 20, 2024 • 724 • 6

bartowski/magnum-v4-72b-GGUF

Text Generation • Updated Oct 20, 2024 • 1.37k • 5

bartowski/magnum-v4-27b-GGUF

Text Generation • Updated Oct 20, 2024 • 1.48k • 2

bartowski/TheBeagle-v2beta-32B-MGS-GGUF

Text Generation • Updated Oct 25, 2024 • 1.43k • 4

mradermacher/ldm_soup_Llama-3.1-8B-Inst-i1-GGUF

Updated about 1 month ago • 119 • 1

mradermacher/lumikabra-195B_v0.3-i1-GGUF

Updated Oct 22, 2024 • 19 • 2

mradermacher/Impish_LLAMA_3B-i1-GGUF

Updated Jan 26 • 640 • 1

Lewdiculous/Mistral-Nemo-12B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix

Updated Dec 18, 2024 • 5.61k • 11

MarsupialAI/Monstral-123B_iMat_GGUF

Text Generation • Updated Oct 24, 2024 • 146 • 2

mradermacher/Delirium-v1-i1-GGUF

Updated Oct 23, 2024 • 466 • 3

mradermacher/Darkest-muse-v1-i1-GGUF

Updated Oct 24, 2024 • 765 • 4

Lewdiculous/Llama-3.1-8B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix

Updated Oct 24, 2024 • 830 • 12

bartowski/aya-expanse-32b-GGUF

Text Generation • Updated Oct 24, 2024 • 3.78k • 18

mradermacher/Llama-3-Yggdrasil-AstralSpice-8B-i1-GGUF

Updated Oct 25, 2024 • 820 • 2

mradermacher/Llama3.1-DarkStorm-Aspire-8B-i1-GGUF

Updated Oct 25, 2024 • 792 • 2

mradermacher/DeepSeek-V2-Lite-XiaAi-i1-GGUF

Updated Jan 22 • 313 • 1

bartowski/Monstral-123B-GGUF

Text Generation • Updated Oct 26, 2024 • 522 • 2

marroyo777/flan-t5-base-Q4_K_M-GGUF

Text2Text Generation • Updated Oct 26, 2024 • 19 • 1

bartowski/Behemoth-123B-v1.1-GGUF

Text Generation • Updated Oct 26, 2024 • 747 • 8

mradermacher/Llama3.1-TheiaFire-DarkFusion-8B-i1-GGUF

Updated Oct 26, 2024 • 487 • 1