RedHatAI
/

Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation

4-bit precision

compressed-tensors

text-generation-inference

4-bit precision

Model card Files Files and versions

robgreenberg3 commited on 10 days ago

Commit

5fea09e

·

verified ·

1 Parent(s): 340e252

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ tags:
 - 4-bit precision
 - gptq
 - compressed-tensors
-license: other
 license_name: llama3.1
 name: RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
 description: This model was obtained by quantizing the weights of Meta-Llama-3.1-8B-Instruct to INT4 data type.

 - 4-bit precision
 - gptq
 - compressed-tensors
+license: llama3.1
 license_name: llama3.1
 name: RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
 description: This model was obtained by quantizing the weights of Meta-Llama-3.1-8B-Instruct to INT4 data type.