Skip to content

Fix Attention GQA implementation on CPU #25966

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
justinchuby merged 15 commits into from
Sep 15, 2025
Merged

Fix Attention GQA implementation on CPU #25966

Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
28de5c5
Fix Attention GQA implementation on CPU
xadupre Sep 5, 2025
f407fd7
add one more unit test
xadupre Sep 5, 2025
7ff71da
negative infinity
xadupre Sep 8, 2025
6eb8ee9
fix last unittest
xadupre Sep 9, 2025
627fe07
fix merge conflicts
xadupre Sep 10, 2025
07745c4
disable onnx test for attention
xadupre Sep 10, 2025
542b5ab
disable
xadupre Sep 10, 2025
08841de
disable
xadupre Sep 10, 2025
db6df58
fix issues
xadupre Sep 10, 2025
abb196e
disable
xadupre Sep 10, 2025
805fe69
Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
xadupre Sep 11, 2025
59ded0c
disable test waiting for onnx
xadupre Sep 11, 2025
5f93b47
disable
xadupre Sep 11, 2025
5c99cf0
disable
xadupre Sep 11, 2025
18b0787
inlien
xadupre Sep 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
disable
  • Loading branch information
@xadupre
xadupre committed Sep 10, 2025
commit 08841deb39b78c5f06434fbc5195fcb8064f91ae
3 changes: 2 additions & 1 deletion onnxruntime/test/testdata/onnx_backend_test_series_filters.jsonc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,8 @@
"^test_attention_3d_gqa_*", // pending onnx update
"^test_attention_4d_gqa_*", // pending onnx update
"^test_attention_*causal*", // pending onnx update
"^test_attention_4d_with_past_and_present_qk_matmul_bias_4d_mask_causal", // pending onnx update
"^test_attention_4d_with_past_and_present_qk_matmul_bias_3d_mask_causal*", // pending onnx update
"^test_attention_4d_with_past_and_present_qk_matmul_bias_4d_mask_causal*", // pending onnx update
"^test_attention_4d_fp16*", // precision issue: 1 / 192 mismatched elements
"^test_attention_4d_fp16_expanded*", // precision issue: 3 / 192 mismatched elements
"^test_l2normalization*", // LpNormalization(22) not implemented
Expand Down
Loading