ktoprakucar
/

Llama-Guard-3-8B-Q8-GPTQ

Text Generation

8-bit precision

Model card Files Files and versions

Llama-Guard-3-8B-Q8-GPTQ

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

ktoprakucar's picture

AutoGPTQ model for meta-llama/Llama-Guard-3-8B: 8bits, gr128, desc_act=True

6a9ced6 verified about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

29 Bytes

initial commit about 1 year ago
config.json

1.22 kB

AutoGPTQ model for meta-llama/Llama-Guard-3-8B: 8bits, gr128, desc_act=True about 1 year ago
gptq_model-8bit-128g.safetensors

9.25 GB
xet

AutoGPTQ model for meta-llama/Llama-Guard-3-8B: 8bits, gr128, desc_act=True about 1 year ago
quantize_config.json

265 Bytes

AutoGPTQ model for meta-llama/Llama-Guard-3-8B: 8bits, gr128, desc_act=True about 1 year ago