Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

35,260

Full-text search

Active filters: bitsandbytes

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 16.8k • 17

HelpMumHQ/MamaBot-Llama

Text Generation • Updated Sep 10, 2024 • 168 • 3

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated 25 days ago • 118k • 76

mlconvexai/jais-13b-chat_bitsandbytes_8bit

Text Generation • Updated Oct 27, 2024 • 45 • 1

unsloth/Qwen2-Math-1.5B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 14 • 1

unsloth/Qwen2-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 14 • 1

unsloth/Qwen2-Math-7B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 14 • 1

unsloth/Qwen2-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 15 • 1

Sergei6000/Qwen2-Audio-7B-Instruct-Int4

Updated Aug 10, 2024 • 297 • 6

PrunaAI/IlyaGusev-gemma-2-2b-it-abliterated-bnb-4bit-smashed

Updated Aug 14, 2024 • 15 • 1

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 27 • 2

PrunaAI/OuteAI-Lite-Oute-1-300M-Instruct-bnb-4bit-smashed

Updated Aug 16, 2024 • 10 • 1

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 11 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 26.2k • 13

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24, 2024 • 430 • 43

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25, 2024 • 27 • 11

unsloth/c4ai-command-r-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 119 • 9

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1, 2024 • 57 • 16

watsonchua/hansard-gemma-2-9b-lora

Updated Sep 2, 2024 • 3 • 1

unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 706 • 5

unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 1.01k • 7

unsloth/c4ai-command-r-plus-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 95 • 3

unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 20 • 1

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 266 • 6

Stratos-Kakalis/complete-SPARQL-tuned-mistral

Text Generation • Updated Sep 4, 2024 • 11 • 1

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14, 2024 • 9 • 9

Salmamoori/llava-bddx-finetuned

Updated Sep 16, 2024 • 9 • 1

unsloth/Mistral-Small-Instruct-2409-bnb-4bit

Updated Nov 22, 2024 • 2.5k • 3

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 780k • 11

unsloth/Qwen2.5-7B-bnb-4bit

Text Generation • Updated Feb 6 • 5.67k • 4