Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

23,061

Full-text search

Active filters: 4-bit

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 21k • 25

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 403 • 4

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 349 • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 10.2k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.41k • 10

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 91 • 2

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 11.2k • 32

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.91k • 3

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 38 • 3

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.07k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.5k • 16

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 1.11k • 20

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 12.8k • 14

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 148 • 8

zamal/gemma-7b-finetuned

Text Generation • Updated Jun 11, 2024 • 126 • 5

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 7.51k • 174

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 263 • 14

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 20 • 1

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.27M • 74

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 1.58M • 75

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 56.5k • 126

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 11k • 22

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 708 • 46

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 8.79k • 21

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 10.5k • 25

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 782 • 42

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 31.5k • 29

Anoop03031988/Phi-3-mini-4k-instruct-text-to-sql-GGUF

Updated Sep 20, 2024 • 5 • 2

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 106 • 1