Skip to content

Conversation

pytorchbot
Copy link
Collaborator

This PR was created by the merge bot to help merge the original PR into the main branch.
ghstack PR number: #6519
^ Please use this as the source of truth for the PR details, comments, and reviews
ghstack PR base: https://github.com/pytorch/executorch/tree/gh/kimishpatel/126/base
ghstack PR head: https://github.com/pytorch/executorch/tree/gh/kimishpatel/126/head
Merge bot PR base: https://github.com/pytorch/executorch/tree/gh/kimishpatel/125/orig
Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/kimishpatel/126/orig
@diff-train-skip-merge

Pull Request resolved: #6517

Dont rely on top level config for optimization and rather set our own for optimized kernels
ghstack-source-id: 251021623
@exported-using-ghexport

Differential Revision: [D64910575](https://our.internmc.facebook.com/intern/diff/D64910575/)
Pull Request resolved: #6518

This enable some optimizations for inlining vectorized lib functions
ghstack-source-id: 251021622
@exported-using-ghexport

Differential Revision: [D64910576](https://our.internmc.facebook.com/intern/diff/D64910576/)
Pull Request resolved: #6519

prefill toks: 21
decode: 11
after: e2e 621ms, prefil:: 370ms, decode: 43.84 tok/sec
ghstack-source-id: 251021625
@exported-using-ghexport

Differential Revision: [D64910578](https://our.internmc.facebook.com/intern/diff/D64910578/)
Copy link

pytorch-bot bot commented Oct 31, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6588

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 54f6c6a with merge base fbb0acf (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 31, 2024
@kirklandsign kirklandsign force-pushed the gh/kimishpatel/125/orig branch from 4348b42 to 8e5b7d0 Compare October 31, 2024 16:45
Base automatically changed from gh/kimishpatel/125/orig to main October 31, 2024 16:46
@kirklandsign kirklandsign merged commit 3a1538a into main Oct 31, 2024
39 checks passed
@kirklandsign kirklandsign deleted the gh/kimishpatel/126/orig branch October 31, 2024 16:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants