Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CPU]Check runtime_options from IR model #27765

Merged
merged 7 commits into from
Nov 30, 2024
Merged

[CPU]Check runtime_options from IR model #27765

merged 7 commits into from
Nov 30, 2024

Conversation

zhangYiIntel
Copy link
Contributor

@zhangYiIntel zhangYiIntel commented Nov 27, 2024 •
edited
Loading

Details:

        <rt_info>
                <runtime_options>
                        <KV_CACHE_PRECISION value="f16" />
                </runtime_options>
        </rt_info>

Tickets:

@zhangYiIntel zhangYiIntel requested review from a team as code owners November 27, 2024 02:42
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: CPU OpenVINO CPU plugin labels Nov 27, 2024
@yuxu42
Copy link
Contributor

yuxu42 commented Nov 27, 2024

Hi @dmitry-gorokhov Could you please take a review? Thanks!

@yuxu42 yuxu42 added this to the 2024.6 milestone Nov 27, 2024
@github-actions github-actions bot removed the category: inference OpenVINO Runtime library - Inference label Nov 28, 2024
@zhangYiIntel zhangYiIntel mentioned this pull request Nov 29, 2024
Merged
github-merge-queue bot pushed a commit that referenced this pull request Nov 29, 2024
@zhangYiIntel
[CPU]Check runtime_options from IR model (#27778)
9aabccb 
### Details:
 - *Check `runtim_options` from IR model*
- *Set `KV_CACHE_PRECISION` & `DYNAMIC_QUANTIZATION_GROUP_SIZE`* from
`runtim_options` of IR model
 - Example IR model with  `runtim_options`
- #27765 to master
branch
```
        <rt_info>
                <runtime_options>
                        <KV_CACHE_PRECISION value="f16" />
                </runtime_options>
        </rt_info>
```

### Tickets:
 - *CVS-157571*
@dmitry-gorokhov dmitry-gorokhov added this pull request to the merge queue Nov 30, 2024
Merged via the queue into openvinotoolkit:master with commit 09d1e50 Nov 30, 2024
170 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ilya-lavrenov ilya-lavrenov ilya-lavrenov left review comments

@dmitry-gorokhov dmitry-gorokhov dmitry-gorokhov approved these changes

@AlexKoff88 AlexKoff88 Awaiting requested review from AlexKoff88

Assignees

@dmitry-gorokhov dmitry-gorokhov

Labels
category: CPU OpenVINO CPU plugin
Projects
None yet
Milestone
2024.6
Development

Successfully merging this pull request may close these issues.
5 participants
@zhangYiIntel @yuxu42 @ilya-lavrenov @dmitry-gorokhov @AlexKoff88