Skip to content

Static attention: support local-global attention #13043

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Aug 4, 2025
Merged

Static attention: support local-global attention #13043

merged 1 commit into from
Aug 4, 2025

Conversation

sxu
Copy link
Contributor

@sxu sxu commented Jul 31, 2025

Summary:
Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Differential Revision: D79267644

@sxu sxu requested review from jackzhxng and lucylq as code owners July 31, 2025 15:56
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jul 31, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13043

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 1 Unrelated Failure

As of commit 1595b73 with merge base 3e70463 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 31, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79267644

@github-actions GitHub Actions
Copy link

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@sxu sxu requested review from YIWENX14 and billmguo July 31, 2025 16:01
@sxu sxu force-pushed the export-D79267644 branch from 7413129 to 5c2f27c Compare August 4, 2025 16:17
sxu added a commit to sxu/executorch that referenced this pull request Aug 4, 2025
@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
5c2f27c 
Summary:

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79267644

sxu added a commit to sxu/executorch that referenced this pull request Aug 4, 2025
@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
08b2735 
Summary:
Pull Request resolved: pytorch#13043

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@sxu sxu force-pushed the export-D79267644 branch from 5c2f27c to 08b2735 Compare August 4, 2025 16:21
sxu added a commit to sxu/executorch that referenced this pull request Aug 4, 2025
@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
1510e3b 
Summary:

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@sxu sxu force-pushed the export-D79267644 branch from 08b2735 to 1510e3b Compare August 4, 2025 16:26
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79267644

@sxu sxu force-pushed the export-D79267644 branch from 1510e3b to 33b52ef Compare August 4, 2025 17:59
sxu added a commit to sxu/executorch that referenced this pull request Aug 4, 2025
@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
33b52ef 
Summary:

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79267644

@sxu sxu force-pushed the export-D79267644 branch from 33b52ef to 07bbd73 Compare August 4, 2025 19:36
sxu added a commit to sxu/executorch that referenced this pull request Aug 4, 2025
@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
07bbd73 
Summary:

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79267644

sxu added a commit to sxu/executorch that referenced this pull request Aug 4, 2025
@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
57dd4dd 
Summary:
Pull Request resolved: pytorch#13043

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@sxu sxu force-pushed the export-D79267644 branch from 07bbd73 to 57dd4dd Compare August 4, 2025 19:40
sxu added a commit to sxu/executorch that referenced this pull request Aug 4, 2025
@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
b72d2d4 
Summary:

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@sxu sxu force-pushed the export-D79267644 branch from 57dd4dd to b72d2d4 Compare August 4, 2025 19:42
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79267644

@sxu @facebook-github-bot
Static attention: support local-global attention (pytorch#13043)
1595b73 
Summary:

Runtime: support different cache lengths for different layer.
Python: add sliding window cache update which was already in the runtime.

Reviewed By: billmguo

Differential Revision: D79267644
@sxu sxu force-pushed the export-D79267644 branch from b72d2d4 to 1595b73 Compare August 4, 2025 20:52
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79267644

@facebook-github-bot facebook-github-bot merged commit 07b6059 into pytorch:main Aug 4, 2025
100 of 105 checks passed
agrima1304 pushed a commit to agrima1304/executorch that referenced this pull request Aug 26, 2025
@sxu @agrima1304
Static attention: support local-global attention
d5f792d 
Differential Revision: D79267644

Pull Request resolved: pytorch#13043
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@billmguo billmguo billmguo approved these changes

@lucylq lucylq Awaiting requested review from lucylq lucylq is a code owner

@jackzhxng jackzhxng Awaiting requested review from jackzhxng jackzhxng is a code owner

@YIWENX14 YIWENX14 Awaiting requested review from YIWENX14

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported topic: not user facing

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@sxu @facebook-github-bot @billmguo