amd
/

Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-bf16-onnx-ryzen-strix

Model card Files Files and versions Community

pooja-ganesh commited on Dec 13, 2024

Commit

41336e4

·

verified ·

1 Parent(s): 630d649

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ base_model:
 - ## Introduction
   This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment.
 - ## Quantization Strategy
-  - AWQ / Group 128 / Asymmetric / BF16 activations
 - ## Quick Start
   For quickstart, refer to npu-llm-artifacts_1.3.0.zip available in [RyzenAI-SW-EA](https://account.amd.com/en/member/ryzenai-sw-ea.html)

 - ## Introduction
   This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment.
 - ## Quantization Strategy
+  - AWQ / Group 128 / Asymmetric / BF16 activations / UINT4 Weights
 - ## Quick Start
   For quickstart, refer to npu-llm-artifacts_1.3.0.zip available in [RyzenAI-SW-EA](https://account.amd.com/en/member/ryzenai-sw-ea.html)