Edit Models filters

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

29,201

Full-text search

Active filters: bitsandbytes

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 46.5k • 26

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 93.7k • 22

mac999/Llama3-8B-BIM

Text Generation • Updated Jul 11, 2024 • 3 • 1

PrunaAI/apple-OpenELM-270M-bnb-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 5 • 1

robinhad/UAlpaca-2.0-Mistral-7B

Text Generation • Updated Jul 14, 2024 • 85 • 1

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 6.78k • 14

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 2.93k • 32

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 5.35k • 31

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 16.2k • 28

unsloth/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 288k • 16

PrunaAI/Aratako-Oumuamua-7b-RP-bnb-4bit-smashed

Text Generation • Updated Jul 24, 2024 • 3 • 1

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 11 • 2

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 6 • 1

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24, 2024 • 551 • 41

unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 3.3k • 5

unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 949 • 6

unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 9 • 1

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 275 • 5

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14, 2024 • 3 • 8

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 200k • 10

unsloth/Qwen2.5-7B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 25.5k • 3

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 18.8k • 7

unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 16.1k • 1

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 19.4k • 3

unsloth/Qwen2.5-3B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 4.95k • 2

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 7.29k • 5

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 6.43k • 11

unsloth/Qwen2.5-1.5B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 6.3k • 1

unsloth/Qwen2.5-0.5B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 12.2k • 1

unsloth/Qwen2.5-14B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 3.41k • 5