Granite 7b - GGUF

4-bit quantized version of instructlab/granite-7b-lab

Downloads last month
11
GGUF
Model size
6.74B params
Architecture
llama

4-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Ifraaaa/ilab-granite

Quantized
(8)
this model