Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

108

Full-text search

Active filters: 16bit

legraphista/datagemma-rag-27b-it-IMat-GGUF

Text Generation • Updated Sep 13, 2024 • 330

legraphista/datagemma-rig-27b-it-IMat-GGUF

Text Generation • Updated Sep 13, 2024 • 252

legraphista/Mistral-Small-Instruct-2409-IMat-GGUF

Text Generation • Updated Sep 18, 2024 • 510

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 1.6k

legraphista/Qwen2.5-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 435

legraphista/Qwen2.5-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 38

legraphista/Qwen2.5-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 73

legraphista/Qwen2.5-14B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 291

legraphista/Qwen2.5-32B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 722

legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 2.09k

legraphista/Qwen2.5-Math-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 4.22k

legraphista/Qwen2.5-Coder-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 3.11k

legraphista/Qwen2.5-Math-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 2.81k

legraphista/Qwen2.5-72B-Instruct-IMat-GGUF

Text Generation • Updated Sep 20, 2024 • 371

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 2.96k

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 3.27k • 1

legraphista/Llama-Guard-3-1B-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 3.87k

akazen/paligemma-3b-vizwizv-16Q

Updated 5 days ago • 7