Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,636

Full-text search

Active filters: 4-bit

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.99k • 7

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 186 • 2

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 156 • 5

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 999 • 1

Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 426 • 24

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 743 • 22

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 113 • 13

Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 578 • 3

Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 78 • 3

Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 147 • 7

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 2.88k • 37

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 232 • 21

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 235 • 18

Qwen/Qwen1.5-4B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 71 • 5

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 70 • 7

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 89 • 13

unsloth/yi-34b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 56 • 3

unsloth/yi-34b-chat-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 103 • 2

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 298 • 9

unsloth/tinyllama-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 38.4k • 4

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 1.98k • 33

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 40 • 3

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 965 • 52

pavankumarbalijepalli/phi2-nl2sql-lora

Text Generation • Updated 17 days ago • 36 • 1

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.97k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.05k • 16

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.59k • 15

solidrust/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 38 • 8

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 282 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 1.58k • 8