Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,939

Full-text search

Active filters: 2-bit

MaziyarPanahi/Matsu-7B-GGUF

Text Generation • Updated Jan 7 • 73

mlx-community/qwen2.5-0.5b-instruct-q2

Text Generation • Updated Jan 9 • 38

MaziyarPanahi/phi3.5_mini_exp_825_uncensored-GGUF

Text Generation • Updated Jan 9 • 583

MaziyarPanahi/phi-2-instruct-v0.1-GGUF

Text Generation • Updated Jan 9 • 330

MaziyarPanahi/phi-2-pytdml-GGUF

Text Generation • Updated Jan 9 • 96

MaziyarPanahi/Phi-3-medium-4k-instruct-GGUF

Text Generation • Updated Jan 9 • 439

MaziyarPanahi/JSL-MedPhi2-2.7B-GGUF

Text Generation • Updated Jan 9 • 136

MaziyarPanahi/Phi-3-mini-4k-instruct-GGUF

Text Generation • Updated Jan 9 • 654

MaziyarPanahi/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • Updated Jan 9 • 260

MaziyarPanahi/fietje-2-instruct-GGUF

Text Generation • Updated Jan 9 • 122

mlx-community/phi-4-abliterated-2bit

Text Generation • Updated Jan 9 • 23

CuckmeisterFuller/phi-4-Q2-mlx

Text Generation • Updated Jan 13 • 34

CuckmeisterFuller/Cydonia-v1.2-Magnum-v4-22B-Q2-mlx

Text Generation • Updated Jan 13 • 29

CuckmeisterFuller/Cydonia-22B-v1.2-Q2-mlx

Updated Jan 14 • 11

CuckmeisterFuller/Cydonia-22B-v1.3-Q2-mlx

Updated Jan 14 • 13

lilmeaty/SmolLM2-135M-Instruct-GPTQ

Text Generation • Updated Jan 15 • 22

XelotX/WizardLM-2-8x22B-GGUF

Text Generation • Updated Jan 16 • 61

lilmeaty/SmolLM2-135M-Instruct-GPTQ-2bit

Text Generation • Updated Jan 16 • 15

roleplaiapp/ReaderLM-v2-Q2_K-GGUF

Text Generation • Updated Jan 19 • 6

roleplaiapp/Dria-Agent-a-3B-Q2_K-GGUF

Text Generation • Updated Jan 19 • 7

roleplaiapp/Dria-Agent-a-7B-Q2_K-GGUF

Text Generation • Updated Jan 19 • 5

roleplaiapp/AceInstruct-72B-Q2_K-GGUF

Text Generation • Updated Jan 19 • 12

roleplaiapp/Wayfarer-12B-Q2_K-GGUF

Text Generation • Updated Jan 19 • 8

roleplaiapp/Codestral-22B-v0.1-Q2_K-GGUF

Text Generation • Updated Jan 19 • 8

roleplaiapp/AceInstruct-1.5B-Q2_K-GGUF

Text Generation • Updated Jan 19 • 8

lilmeaty/xfsfsfsf-2bit

Text Generation • Updated Feb 6 • 27

umgbhalla/mlx-DeepSeek-R1-Distill-Qwen-1.5B-v0.1-2bit

Text Generation • Updated Jan 22 • 24

roleplaiapp/ALIA-40b-Q2_K-GGUF

Text Generation • Updated Jan 22 • 37

roleplaiapp/ALIA-40b-Q6_K-GGUF

Text Generation • Updated Jan 23 • 52

MaziyarPanahi/SuperThoughts-CoT-14B-16k-o1-QwQ-GGUF

Text Generation • Updated Jan 24 • 655