Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,449

Full-text search

Active filters: 4-bit

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 859 • 252

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 80 • 1

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 47 • 18

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.69k • 5

unsloth/gemma-1.1-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 115 • 3

unsloth/Hermes-2-Pro-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 1.76k • 1

unsloth/OpenHermes-2.5-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 2.11k • 3

taeminlee/KULLM3-awq

Text Generation • Updated Apr 8, 2024 • 72 • 6

unsloth/codegemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 499 • 1

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.74k • 3

unsloth/codegemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 691 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.66M • 74

somosnlp/LLM_SQL_BaseDatosEspanol_Mistral

Text Generation • Updated Apr 25, 2024 • 79 • 11

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 328 • 14

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 2.4M • 78

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 106k • 126

GGmorello/FLAMES

Text Generation • Updated Jun 11, 2024 • 14 • 1

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 214k • 168

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 8.33k • 22

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 103k • 196

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 53.7k • 131

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 2.37k • 46

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • Updated Apr 21, 2024 • 23 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 91 • 21

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 6.31k • 25

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.19k • 42

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 2.29M • 13

Qwen/Qwen1.5-110B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 69 • 17

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 10 • 2

Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 45 • 9