Edit Models filters

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

text-embeddings-inference

Misc with no match

Carbon Emissions

Mixture of Experts

Models

269

Full-text search

Active filters: granite

neuralmagic/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • Updated about 13 hours ago • 128 • 1

robinsmits/Schaapje-2B-Chat-V1.0

Text Generation • Updated 12 days ago • 107 • 2

instructlab/granite-7b-lab

Text Generation • Updated Jun 5, 2024 • 6.94k • 42

instructlab/granite-7b-lab-GGUF

Updated Apr 24, 2024 • 4.17k • 24

ibm-granite/granite-20b-code-base-8k

Text Generation • Updated Sep 2, 2024 • 180 • 13

ibm-granite/granite-8b-code-base-4k

Text Generation • Updated Sep 2, 2024 • 588 • 29

ibm-granite/granite-34b-code-base-8k

Text Generation • Updated Sep 2, 2024 • 239 • 19

ibm-granite/granite-3b-code-base-2k

Text Generation • Updated Sep 2, 2024 • 7.13k • 36

ibm-granite/granite-20b-code-instruct-8k

Text Generation • Updated Sep 2, 2024 • 384 • 39

mlx-community/granite-20b-code-instruct-4bit

Text Generation • Updated May 14, 2024 • 17

mlx-community/granite-20b-code-instruct-8bit

Text Generation • Updated May 14, 2024 • 6

mlx-community/granite-20b-code-base-4bit

Text Generation • Updated May 14, 2024 • 9

mlx-community/granite-20b-code-base-8bit

Text Generation • Updated May 14, 2024 • 9

mlx-community/granite-34b-code-base-4bit

Text Generation • Updated May 14, 2024 • 6 • 1

mlx-community/granite-34b-code-base-8bit

Text Generation • Updated May 14, 2024 • 15 • 1

mlx-community/granite-34b-code-instruct-4bit

Text Generation • Updated May 14, 2024 • 5 • 1

mlx-community/granite-34b-code-instruct-8bit

Text Generation • Updated May 14, 2024 • 8

newsletter/granite-3b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10, 2024 • 3

newsletter/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10, 2024 • 2

newsletter/granite-20b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10, 2024 • 4

upendrab/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 10, 2024 • 2

cobrakenji/granite-8b-code-instruct-Q3_K_M-GGUF

Text Generation • Updated May 11, 2024 • 3

cobrakenji/granite-20b-code-instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 10, 2024 • 10

cobrakenji/granite-3b-code-base-Q5_K_M-GGUF

Text Generation • Updated May 11, 2024 • 10

cobrakenji/granite-34b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 10, 2024 • 12 • 2

cpellens/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 11, 2024 • 3

TomWest/granite-8b-code-instruct-Q5_K_S-GGUF

Text Generation • Updated May 13, 2024 • 1

cobrakenji/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 13, 2024 • 3

MoMonir/granite-8b-code-instruct-GGUF

Text Generation • Updated May 14, 2024 • 30

cobrakenji/granite-20b-code-base-Q3_K_M-GGUF

Text Generation • Updated May 16, 2024 • 8