Hugging Face's logo

mahihossain666
/
llama-2-70b-hf-quantized-3bits-GPTQ

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
3-bit
gptq
Model card Files Community

Quantized to 3bit precision using AutoGPTQ.

Downloads last month
3
Safetensors
Model size
7.54B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ