Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

Misc with no match

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

16

Full-text search

Active filters: llamacpp

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 11 days ago • 94

Vikhrmodels/Vikhr-Gemma-2B-instruct-GGUF

Text Generation • Updated Aug 23, 2024 • 1.33k • 15

flowaicom/Flow-Judge-v0.1-GGUF

Text Generation • Updated Sep 18, 2024 • 25 • 9

Vikhrmodels/Vikhr-Llama-3.2-1B-instruct-GGUF

Text Generation • Updated Sep 27, 2024 • 1.42k • 10

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_GGUF

Updated Feb 3 • 1.03k • 9

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-r_GGUF

Updated about 1 month ago • 2.28k • 4

kroonen/neural-chat-7b-v3-1-GGUF

Updated Nov 28, 2023 • 23

Druvith/mistralmed-7b-v1.5.gguf

Updated Feb 3, 2024 • 11

rxavier/Taurus-7B-1.0-GGUF

Updated Feb 25, 2024 • 32

BramVanroy/GEITje-7B-ultra-GGUF

Updated Dec 6, 2024 • 555 • 8

Vikhrmodels/it-5.3-fp16-32k-GGUF

Updated Jun 13, 2024 • 275 • 2

rubra-ai/Meta-Llama-3-8B-Instruct-GGUF

Updated Jul 4, 2024 • 250 • 4

Vikhrmodels/it-5.4-fp16-orpo-v2-GGUF

Updated Jul 14, 2024 • 384 • 4

Dracones/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 20, 2024 • 70

Dracones/gemma-2-27b-it-GGUF

Text Generation • Updated Jul 22, 2024 • 46

Vikhrmodels/Vikhr-Qwen-2.5-0.5B-instruct-GGUF

Text Generation • Updated Oct 6, 2024 • 321 • 6