Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

4-bit precision

Inference Endpoints

text-generation-inference

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

221

Full-text search

Active filters: 4bit

legraphista/Qwen2.5-32B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 722

legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 2.09k

legraphista/Qwen2.5-Math-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 4.22k

legraphista/Qwen2.5-Coder-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 3.11k

legraphista/Qwen2.5-Math-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 2.81k

legraphista/Qwen2.5-72B-Instruct-IMat-GGUF

Text Generation • Updated Sep 20, 2024 • 371

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 2.96k

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 3.27k • 1

legraphista/Llama-Guard-3-1B-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 3.87k

Narrator5000/llavanext-finetuned-stackoverflow-vqa

Updated Sep 29, 2024 • 9 • 1

NeoChen1024/internlm2_5-20b-chat-exl2-4.25bpw-h8

Text Generation • Updated Sep 30, 2024 • 9

ussipan/SipanGPT-0.1-Llama-3.2-1B-GGUF

Text2Text Generation • Updated Oct 19, 2024 • 216 • • 1

ussipan/SipanGPT-0.2-Llama-3.2-1B-GGUF

Text2Text Generation • Updated Oct 19, 2024 • 146

mcavus/glm-4v-9b-gptq-4bit-dynamo

Updated Oct 10, 2024 • 8 • 1

ussipan/SipanGPT-0.3-Llama-3.2-1B-GGUF

Text2Text Generation • Updated Dec 23, 2024 • 85 • 1

harishnair04/Gemma-medtr-2b-sft

Text Generation • Updated Nov 7, 2024 • 17

harishnair04/Gemma-medtr-2b-sft-v2

Text Generation • Updated Nov 15, 2024 • 16

mradermacher/Gemma-medtr-2b-sft-v2-GGUF

Updated Nov 16, 2024 • 171

NaomiBTW/L3-8B-Lunaris-v1-GPTQ

Text Generation • Updated Nov 11, 2024

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1

Text Generation • Updated Dec 18, 2024 • 85 • 51

nisten/qwen2.5-coder-7b-abliterated-128k-AWQ

Text Generation • Updated Jan 7 • 81

mlx-community/Qwen2.5-7B-Instruct-kowiki-qa-4bit

Text Generation • Updated Dec 20, 2024 • 10

ModelCloud/Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1

Text Generation • Updated Dec 21, 2024 • 40 • 3

adriabama06/SmallThinker-3B-Preview-AWQ

Text Generation • Updated Jan 3 • 20 • 1

exxocism/Linkbricks-Horizon-AI-Llama-3.3-Korean-70B-sft-dpo-GGUF

Text Generation • Updated Jan 7

ehristoforu/Phi4-MoE-2x14B-Instruct

Text Generation • Updated Jan 9 • 42

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 139

curiousmind147/microsoft-phi-4-AWQ-4bit-GEMM

Text Generation • Updated Feb 4 • 135

ConfidentialMind/Virtuoso-Medium-v2_GPTQ_G128_W4A16

Text Generation • Updated 26 days ago • 13

ConfidentialMind/Virtuoso-Medium-v2_GPTQ_G32_W4A16

Text Generation • Updated 26 days ago • 15