Edit Models filters

Model Tree

ibm-granite/granite-3.1-8b-base

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

18

Full-text search

Active filters: ibm-granite/granite-3.1-8b-base

DevQuasar/ibm-granite.granite-3.1-8b-base-GGUF

Text Generation • Updated Feb 1 • 913 • 1

ticlazau/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 18

QuantFactory/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 604 • 7

mradermacher/granite-3.1-8b-base-GGUF

Updated Dec 20, 2024 • 42

mradermacher/granite-3.1-8b-base-i1-GGUF

Updated Dec 20, 2024 • 114

itlwas/granite-3.1-8b-base-Q4_K_M-GGUF

Updated Dec 23, 2024 • 12

tensorblock/granite-3.1-8b-base-GGUF

Updated Jan 1 • 52

Triangle104/granite-3.1-8b-base-Q4_K_S-GGUF

Updated Jan 12 • 5

Triangle104/granite-3.1-8b-base-Q4_K_M-GGUF

Updated Jan 12 • 7

Triangle104/granite-3.1-8b-base-Q5_K_S-GGUF

Updated Jan 12 • 5

Triangle104/granite-3.1-8b-base-Q5_K_M-GGUF

Updated Jan 12 • 8

Triangle104/granite-3.1-8b-base-Q6_K-GGUF

Updated Jan 12 • 7

Triangle104/granite-3.1-8b-base-Q8_0-GGUF

Updated Jan 12 • 4

neuralmagic/granite-3.1-8b-base-quantized.w8a8

Text Generation • Updated 27 days ago • 49

neuralmagic/granite-3.1-8b-base-quantized.w4a16

Text Generation • Updated 27 days ago • 35

neuralmagic/granite-3.1-8b-base-FP8-dynamic

Text Generation • Updated Feb 20 • 22

async0x42/granite-3.1-8b-instruct-exl2_4.65bpw

Text Generation • Updated Jan 24 • 8

TheMelonGod/granite-3.1-8b-base-exl2

Text Generation • Updated Jan 29 • 15