--- license: llama2 language: - en library_name: transformers tags: - facebook - meta - pytorch - llama - llama-2 - 4bit - gptq base_model: meta-llama/LlamaGuard-7b --- # Quantized version of meta-llama/LlamaGuard-7b ## Model Description The model [meta-llama/LlamaGuard-7b](https://huggingface.co/meta-llama/LlamaGuard-7b) was quantized to 4bit, group_size 128, and act-order=True with auto-gptq integration in transformers (https://huggingface.co/blog/gptq-integration).