Skip to content

[CPU] add checking on attention_mask of SDPA #30133

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

[CPU] add checking on attention_mask of SDPA #30133

wants to merge 1 commit into from
+13 −1

Conversation

tiger100256-hu
Copy link
Contributor

@tiger100256-hu tiger100256-hu commented Apr 15, 2025 •
edited
Loading

Details:

  • also check the attention mask in the shape infer of ScaledDotProductAttentionWithKVCache

Tickets:

@github-actions github-actions bot added the category: CPU OpenVINO CPU plugin label Apr 15, 2025
@tiger100256-hu tiger100256-hu force-pushed the huyuan/add_checking_on_SDPA branch 2 times, most recently from b376ab4 to 1b6451c Compare April 17, 2025 02:07
@tiger100256-hu tiger100256-hu changed the title [CPU] add checking in SDPA while second token input size is not 1 [CPU] add checking on attention_mask of SDPA Apr 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: CPU OpenVINO CPU plugin
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@tiger100256-hu