Skip to content

Commit

Permalink
Update genai-guide-npu.rst
Browse files Browse the repository at this point in the history
Fixed typo in parameter, updated to --group-size
  • Loading branch information
avitial authored Dec 26, 2024
1 parent c14134a commit 131b4d7
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ You select one of the methods by setting the ``--group-size`` parameter to eithe
.. code-block:: console
:name: group-quant
optimum-cli export openvino -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 --weight-format int4 --sym --ratio 1.0 --group_size 128 TinyLlama-1.1B-Chat-v1.0
optimum-cli export openvino -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 --weight-format int4 --sym --ratio 1.0 --group-size 128 TinyLlama-1.1B-Chat-v1.0
.. tab-item:: Channel-wise quantization

Expand Down

0 comments on commit 131b4d7

Please sign in to comment.