OpenVINO-NPU
Collection
1 item
•
Updated
This model was converted to the OpenVINO IR format in compliance with the documentation for use with NPU devices.
I used this command:
optimum-cli export openvino -m "input/path" --weight-format int4 --sym --group-size -1 --ratio 1.0 --awq --scale-estimation --dataset wikitext2 "output/path"