Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Misc with no match

Carbon Emissions

Mixture of Experts

Models

356

Full-text search

Active filters: granite

mradermacher/granite-20b-code-base-8k-GGUF

Updated Sep 4, 2024 • 59

mradermacher/granite-20b-code-instruct-8k-GGUF

Updated Sep 3, 2024 • 267

mradermacher/granite-20b-code-instruct-8k-i1-GGUF

Updated Sep 6, 2024 • 536

mradermacher/granite-34b-code-base-8k-GGUF

Updated Sep 4, 2024 • 216

mradermacher/granite-3b-code-base-128k-i1-GGUF

Updated Sep 4, 2024 • 308

mradermacher/granite-3b-code-instruct-2k-i1-GGUF

Updated Sep 4, 2024 • 369

mradermacher/granite-20b-code-base-8k-i1-GGUF

Updated Sep 4, 2024 • 256

mradermacher/granite-8b-code-base-4k-i1-GGUF

Updated Sep 5, 2024 • 128

mradermacher/granite-34b-code-base-8k-i1-GGUF

Updated Sep 4, 2024 • 289

QuantFactory/granite-7b-instruct-GGUF

Text Generation • Updated Sep 5, 2024 • 84 • 2

royleibov/granite-7b-instruct-ZipNN-Compressed

Text Generation • Updated Sep 15, 2024 • 41 • 2

QuantFactory/granite-3b-code-base-2k-GGUF

Text Generation • Updated Sep 7, 2024 • 178 • 2

QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 1.25k • 2

QuantFactory/granite-8b-code-instruct-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 1.6k • 3

QuantFactory/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Sep 7, 2024 • 123 • 2

mradermacher/granite-34b-code-instruct-8k-GGUF

Updated Sep 9, 2024 • 256 • 1

mradermacher/granite-34b-code-instruct-8k-i1-GGUF

Updated Sep 9, 2024 • 372

ethangoh/granite-7b-instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 17, 2024 • 10

rh-rad-ai-roadshow/parasol-instruct

Updated Nov 13, 2024 • 7

royleibov/granite-3b-code-base-128k-ZipNN-Compressed

Text Generation • Updated Oct 3, 2024 • 30 • 2

ibm-granite/granite-3.0-2b-instruct

Text Generation • Updated Dec 19, 2024 • 22.5k • • 47

onnx-community/granite-3.0-2b-instruct

Text Generation • Updated 7 days ago • 26

royleibov/granite-3.0-8b-instruct-ZipNN-Compressed

Text Generation • Updated Oct 22, 2024 • 49

takumar24/granite-3.0-8b-instruct-gptq

Updated Oct 23, 2024 • 4

tjake/granite-3.0-2b-instruct-JQ4

Text Generation • Updated Oct 27, 2024 • 25

pingel/granite-3.0-2b-instruct-pirate

Text Generation • Updated Oct 28, 2024 • 7

mav23/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Nov 1, 2024 • 188

mav23/granite-8b-code-instruct-128k-GGUF

Text Generation • Updated Nov 3, 2024 • 613 • 1

tensorblock/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Nov 16, 2024 • 112

atrokhym/granite-3.0-2b-instruct-pirate

Text Generation • Updated Nov 7, 2024 • 6