Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

25,599

Full-text search

Active filters: 8-bit

mobiuslabsgmbh/Llama-3.1-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 250 • 1

mobiuslabsgmbh/Llama-3.2-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 38 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 36 • 1

mobiuslabsgmbh/Qwen2.5-14B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 28 • 1

neuralmagic/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation • Updated 19 days ago • 1.18k • 2

mobiuslabsgmbh/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 53 • 2

Alissonerdx/YuE-s1-7B-anneal-en-cot-exl2-8.0bpw

Text Generation • Updated Feb 6 • 1.29k • 1

neuralmagic/DeepSeek-R1-Llama-70B-quantized.w8a8

Updated Feb 7 • 75 • 1

S010/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q8-mlx

Text Generation • Updated Feb 8 • 177 • 2

noneUsername/Mistral-Small-24B-Instruct-2501-W8A8

Updated 27 days ago • 141 • 1

MaziyarPanahi/Qwen2.5-14B-Instruct-1M-GGUF

Text Generation • Updated Feb 8 • 215 • 2

Severian/Glyphstral-24b-v1

Updated Feb 11 • 194 • 13

MikeRoz/ArliAI_Llama-3.3-70B-ArliAI-RPMax-v1.4-8.0bpw-h8-exl2

Updated Feb 10 • 55 • 2

mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1_4bitgs64_hqq_hf

Text Generation • Updated Feb 10 • 64 • 1

driaforall/Tiny-Agent-a-3B-Q8-mlx

Updated Feb 11 • 52 • 2

driaforall/Tiny-Agent-a-1.5B-Q8-mlx

Updated Feb 11 • 33 • 2

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-r_MLX-8bit

Text Generation • Updated Feb 11 • 60 • 1

AlejandroOlmedo/DeepSeek-R1-Distill-Qwen-7B-GRPO_Math-8bit-mlx

Text Generation • Updated 22 days ago • 191 • 3

rinna/qwen2.5-bakeneko-32b-instruct-gptq-int8

Text Generation • Updated Feb 14 • 111 • 1

MaziyarPanahi/DarkIdol-LongWriter-8B-Uncensored-1048k-GGUF

Text Generation • Updated Feb 12 • 807 • 1

EliasOenal/Mistral-Small-24B-Instruct-2501-W8A8-dynamic

Text Generation • Updated Feb 12 • 459 • 2

MaziyarPanahi/german-r1-GGUF

Text Generation • Updated Feb 12 • 581 • 1

driaforall/Tiny-Agent-a-0.5B-Q8-mlx

Updated Feb 12 • 25 • 2

AlejandroOlmedo/DeepScaleR-1.5B-Preview-8bit-mlx

Text Generation • Updated 22 days ago • 162 • 2

mlx-community/simplescaling-s1.1-32B-8bit

Text Generation • Updated 30 days ago • 30 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W8A8

Text Generation • Updated Feb 14 • 55 • 1

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • Updated Feb 14 • 599 • 1

Statuo/Cydonia-24B-v2-EXL2-8bpw

Updated Feb 14 • 59 • 1

AlejandroOlmedo/zeta-8bit-mlx

Updated 27 days ago • 40 • 1

Pinkstack/Superthoughts-lite-v1-Q8-mlx

Text Generation • Updated about 1 month ago • 54 • 1