Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TEST][DONT REVIEW] Hunyuan kvcache gqa optimization #28204

Open
wants to merge 3 commits into
base: releases/2024/6
Choose a base branch
from
Open

[TEST][DONT REVIEW] Hunyuan kvcache gqa optimization #28204

wants to merge 3 commits into from
+57 −28

Conversation

zhaohb
Copy link
Contributor

@zhaohb zhaohb commented Dec 25, 2024

Details:

  • fix the issue that the hunyuan model cannot use openvino inference.
  • gqa fusion

@github-actions github-actions bot added category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations labels Dec 25, 2024
@zhaohb zhaohb changed the title [TEST][DONT REVIEW] Hunyuan kv cache gqa 2024 6 [TEST][DONT REVIEW] Hunyuan kvcache gqa optimization Dec 25, 2024
@zhaohb zhaohb marked this pull request as ready for review December 25, 2024 15:23
@zhaohb zhaohb requested review from a team as code owners December 25, 2024 15:23
@zhaohb zhaohb requested review from itikhono and removed request for a team December 25, 2024 15:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@itikhono itikhono Awaiting requested review from itikhono itikhono is a code owner automatically assigned from openvinotoolkit/openvino-ie-transformations-maintainers

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations do_not_merge do_not_review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@zhaohb