Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,939

Full-text search

Active filters: 2-bit

roleplaiapp/Cydonia-24B-v2a-Q2_K-GGUF

Text Generation • Updated Feb 2 • 8

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q2_K-GGUF

Text Generation • Updated Feb 2 • 12

roleplaiapp/Confucius-o1-14B-Q2_K-GGUF

Text Generation • Updated Feb 2 • 10

roleplaiapp/DeepSeek-R1-Distill-sthenno-14b-0121-Q2_K-GGUF

Text Generation • Updated Feb 2 • 9

roleplaiapp/DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q2_K-GGUF

Text Generation • Updated Feb 3 • 567

roleplaiapp/Crumb-13B-Q2_K-GGUF

Text Generation • Updated Feb 3 • 2

roleplaiapp/plato-9b-Q2_K-GGUF

Text Generation • Updated Feb 3 • 5

roleplaiapp/SJT-Moe2x7.5B-Q2_K-GGUF

Text Generation • Updated Feb 3 • 7

roleplaiapp/Llama3-Chinese-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Feb 3 • 2

roleplaiapp/Apteed-LLM-Instruct-Q2_K-GGUF

Text Generation • Updated Feb 3 • 3

AlfRjw/DeepSeek-R1-Distill-Llama-8B-abliterated-Q2-mlx

Text Generation • Updated Feb 3 • 18

AlfRjw/NeuralDaredevil-8B-abliterated-Q2-mlx

Updated Feb 4 • 12

sleepdeprived3/sleepdeprived3_Anubis-Pro-105B-v1_EXL2_2bpw_H8

Updated Feb 5 • 24

CuckmeisterFuller/Dolphin3.0-Mistral-24B-Q2-mlx

Text Generation • Updated Feb 8 • 36

MaziyarPanahi/Sqweeks-7B-Instruct-GGUF

Text Generation • Updated Feb 8 • 151

ainugget/Monstral-123B-v2-Q2-MLX

Text Generation • Updated Feb 9 • 7

mlx-community/DeepSeek-R1-2bit

Text Generation • Updated 8 days ago • 361 • 6

MaziyarPanahi/IFeelSoSprunki-8B-Llama3.1-GGUF

Text Generation • Updated Feb 10 • 99

MaziyarPanahi/DeepSeek-Grand-Horror-SMB-R1-Distill-Llama-3.1-16B-GGUF

Text Generation • Updated Feb 10 • 90

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • Updated Feb 10 • 468

MaziyarPanahi/Qwen-2.5-7B-Exp-Sce-GGUF

Text Generation • Updated Feb 10 • 32

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • Updated Feb 10 • 147

MaziyarPanahi/Qwen2.5-7B-Gordion-v0.1-Prose-GGUF

Text Generation • Updated Feb 10 • 305

MaziyarPanahi/Llama-Krikri-8B-Instruct-GGUF

Text Generation • Updated Feb 10 • 103

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-2.0bpw

Updated about 1 month ago • 17

MaziyarPanahi/QVikhr-2.5-1.5B-Instruct-r-GGUF

Text Generation • Updated about 1 month ago • 279

MaziyarPanahi/S1_4o_mini-GGUF

Text Generation • Updated about 1 month ago • 206

MaziyarPanahi/Intelligence-Agent-7B-GGUF

Text Generation • Updated about 1 month ago • 211

MaziyarPanahi/SAXON-0-GGUF

Text Generation • Updated about 1 month ago • 189

Siddharth63/Qwen2.5-14B-Instruct-AutoRound-GPTQ-2bit

Updated 28 days ago • 18