Hugging Face's logo

neuralmagic
/
Meta-Llama-3-8B-Instruct-quantized.w4a16

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Meta-Llama-3-8B-Instruct-quantized.w4a16 / quantize_config.json

Commit History

Upload quantize_config.json with huggingface_hub
6509ea5
verified

abhinavnmagic commited on