-
Notifications
You must be signed in to change notification settings - Fork 712
[ET-VK][ez] Don't copy zeros for cache tensors #15580
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Currently, cache tensors for SDPA are prepacked even though the mutable buffer data just contains zeros. For fused SDPA, this step can be skipped. Differential Revision: [D86226137](https://our.internmc.facebook.com/intern/diff/D86226137/) [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15580
Note: Links to docs will display an error until the docs builds have been completed. ❌ 2 New Failures, 1 Cancelled Job, 5 Unrelated FailuresAs of commit e99ada1 with merge base bde6b11 ( NEW FAILURES - The following jobs have failed:
FLAKY - The following job failed but was likely due to flakiness present on trunk:
BROKEN TRUNK - The following jobs failed but was present on the merge base:👉 Rebase onto the `viable/strict` branch to avoid these failures
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
Currently, cache tensors for SDPA are prepacked even though the mutable buffer data just contains zeros. For fused SDPA, this step can be skipped. Differential Revision: [D86226137](https://our.internmc.facebook.com/intern/diff/D86226137/) ghstack-source-id: 320850472 Pull Request resolved: #15580
This PR needs a
|
27d7579
into
gh/SS-JIA/351/base
Currently, cache tensors for SDPA are prepacked even though the mutable buffer data just contains zeros. For fused SDPA, this step can be skipped. Differential Revision: [D86226137](https://our.internmc.facebook.com/intern/diff/D86226137/) ghstack-source-id: 320850472 Pull Request resolved: #15580
Stack from ghstack (oldest at bottom):
Currently, cache tensors for SDPA are prepacked even though the mutable buffer data just contains zeros.
For fused SDPA, this step can be skipped.
Differential Revision: D86226137