Edit Models filters

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

29,197

Full-text search

Active filters: bitsandbytes

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 349 • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 10.2k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.41k • 10

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 91 • 2

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 11.2k • 32

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.91k • 3

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.07k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.5k • 16

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 1.11k • 20

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 12.8k • 14

zamal/gemma-7b-finetuned

Text Generation • Updated Jun 11, 2024 • 126 • 5

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 7.51k • 174

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 263 • 14

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 20 • 1

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19 • 1

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 21 • 1

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 708 • 46

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 8.79k • 21

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 782 • 42

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 31.5k • 29

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 106 • 1

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 37.3k • 15

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 71.1k • 18

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.09k • 5

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 1.29k • 28

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 551 • 26

SeacomSrl/SeaPhi3-medium

Text Generation • Updated Jul 15, 2024 • 5.09k • 4

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.48k • 1

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 808 • 28

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 104 • 1