[Cutlass] Include fp8 headers in aoti cpp wrapper #155173

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Closed

mlazos wants to merge 11 commits into gh/mlazos/57/base from gh/mlazos/57/head

Contributor

mlazos commented Jun 4, 2025 •

edited

Loading

Stack from ghstack (oldest at bottom):

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @chenyang78 @kadeng @muchulee8 @amjames @chauhang @aakhundov


          [Cutlass] Include fp8 headers in aoti cpp wrapper

b63178f

[ghstack-poisoned]

This was referenced Jun 4, 2025

[Cutlass] EVT dynamic shapes support #154835

Closed

[Cutlass] fp8 dynamic shapes test #154829

Closed

pytorch-bot bot commented Jun 4, 2025 •

edited

Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/155173

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 10cc74b with merge base 7cf5b36 ():

UNSTABLE - The following jobs are marked as unstable, possibly due to flakiness on trunk:

pull / linux-jammy-py3-clang12-executorch / build (gh) (#150261)
Final attempt failed. Child_process exited with error code 1
pull / unstable-linux-focal-cuda12.6-py3.10-gcc11-sm89-xfail / build (gh)
ninja: build stopped: subcommand failed

This comment was automatically generated by Dr. CI and updates every 15 minutes.

pytorch-bot bot added ciflow/inductor module: inductor release notes: inductor (aoti) labels

mlazos added a commit that referenced this pull request


          [Cutlass] Include fp8 headers in aoti cpp wrapper

fd972ef

ghstack-source-id: 3a399c1
Pull Request resolved: #155173

mlazos requested a review from desertfire

June 5, 2025 04:05


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

7b4e6eb

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

25c3c6d

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]

mlazos mentioned this pull request

[Cutlass] Allow filtering by fast_accum for scaled_mm #155195

Closed


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

08dee9d

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]

mlazos added a commit that referenced this pull request


          [Cutlass] Include fp8 headers in aoti cpp wrapper

ef50c98

ghstack-source-id: 2b8ee4f
Pull Request resolved: #155173


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

96e8b39

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

81885e3

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

4b212a7

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

8f684f1

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]

mlazos added a commit that referenced this pull request


          [Cutlass] Include fp8 headers in aoti cpp wrapper

50083f9

ghstack-source-id: 43ff6c6
Pull Request resolved: #155173

desertfire approved these changes

View reviewed changes


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

f27a9fc

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]

mlazos added a commit that referenced this pull request


          [Cutlass] Include fp8 headers in aoti cpp wrapper

3b51939

ghstack-source-id: 12d1c5c
Pull Request resolved: #155173


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

0b65fd0

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]

mlazos added a commit that referenced this pull request


          [Cutlass] Include fp8 headers in aoti cpp wrapper

c3f784a

ghstack-source-id: a9256fc
Pull Request resolved: #155173

desertfire reviewed

View reviewed changes

torch/csrc/inductor/aoti_runtime/utils_cuda.h Outdated Show resolved Hide resolved


          Update on "[Cutlass] Include fp8 headers in aoti cpp wrapper"

10cc74b

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy chenyang78 kadeng muchulee8 amjames chauhang aakhundov

[ghstack-poisoned]

mlazos added a commit that referenced this pull request


          [Cutlass] Include fp8 headers in aoti cpp wrapper

0d87736

ghstack-source-id: 9e05cf0
Pull Request resolved: #155173

Contributor Author

mlazos commented Jun 10, 2025

@pytorchbot merge

pytorch-bot bot added the ciflow/trunk label

pytorchmergebot added the merging label

Collaborator

pytorchmergebot commented Jun 10, 2025

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

Collaborator

pytorchmergebot commented Jun 10, 2025

Merge failed

Reason: 2 mandatory check(s) failed. The first few are:

Dig deeper by viewing the failures on hud

Details for Dev Infra team

Raised by workflow job

Failing merge rule: Core Maintainers

pytorchmergebot removed the merging label

Contributor Author

mlazos commented Jun 11, 2025

@pytorchbot merge

pytorchmergebot added the merging label

Collaborator

pytorchmergebot commented Jun 11, 2025

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

pytorchmergebot added the Merged label

pytorchmergebot closed this in

3040ca6

pytorchmergebot removed the merging label

github-actions bot deleted the gh/mlazos/57/head branch

July 13, 2025 02:24

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/inductor ciflow/trunk Merged module: inductor release notes: inductor (aoti)