mlabonne/Llama-3-12B AWQ

Model Summary

Llama-3-12B is a merge of the following models using LazyMergekit:

Downloads last month
6
Safetensors
Model size
2.45B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for solidrust/Llama-3-12B-AWQ

Quantized
(4)
this model