Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,470

Full-text search

Active filters: 4-bit

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.7k • 2

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.26k • 4

unsloth/Qwen2-7B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.22k • 6

unsloth/Qwen2-72B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 137 • 4

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 1.77M • 11

unsloth/Qwen2-1.5B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.68k • 6

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 495k • 3

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 620 • 32

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 23 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 2.33M • 16

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 84 • 1

PrunaAI/llmware-bling-phi-3-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 22 • 1

Tom158/Llama3_8B-Inst_NutritionAI

Text Generation • Updated Jun 21, 2024 • 148 • 1

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 23 • 1

IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq

Text Generation • Updated 30 days ago • 477 • 2

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26, 2024 • 1.53k • 4

shuyuej/MedLLaMA3-70B-base-AWQ

Text Generation • Updated Jun 26, 2024 • 2 • 1

ASSERT-KTH/FLAMES-100k

Text Generation • Updated Jun 26, 2024 • 32 • 1

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 44.8k • 27

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.74k • 14

ModelCloud/gemma-2-9b-it-gptq-4bit

Text Generation • Updated Jul 9, 2024 • 160 • 4

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3, 2024 • 827 • 10

cattoroboto/gemma-2-9b-CharacterCodex-qlora

Updated Jul 2, 2024 • 4 • 1

unsloth/Phi-3-mini-4k-instruct-v0-bnb-4bit

Text Generation • Updated Aug 20, 2024 • 149 • 3

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 32.9k • 27

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.09k • 12

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 470 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 136 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 131 • 1

mac999/Llama3-8B-BIM

Text Generation • Updated Jul 11, 2024 • 31 • 1