Edit Models filters

Inference Providers

HF Inference API

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5

Full-text search

Active filters: Bitsandbytes

JohnConnor123/Qwen2.5-0.5B-Instruct-BNB-4bit

Text Generation • Updated Jan 10 • 8

JohnConnor123/Qwen-Qwen2.5-0.5B-Instruct-BNB-4bit

Text Generation • Updated Jan 9 • 5

JohnConnor123/QwQ-0.5B-Distilled-SFT-BNB-4bit

Text Generation • Updated 19 days ago • 17

JohnConnor123/nano-mistral-BNB-4bit

Text Generation • Updated 19 days ago • 32

JohnConnor123/nano-mistral-BNB-8bit

Text Generation • Updated 19 days ago • 14