Skip to content

Conversation

ezyang
Copy link
Contributor

@ezyang ezyang commented Sep 26, 2023

Stack from ghstack (oldest at bottom):

Fixes #109871

Signed-off-by: Edward Z. Yang ezyang@meta.com

Fixes #109871

Signed-off-by: Edward Z. Yang <ezyang@meta.com>

[ghstack-poisoned]
@ezyang ezyang requested review from Chillee and a team as code owners September 26, 2023 20:07
@pytorch-bot
Copy link

pytorch-bot bot commented Sep 26, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/110103

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Unrelated Failure

As of commit 657771a with merge base 0dcea70 (image):

NEW FAILURE - The following job has failed:

FLAKY - The following job failed but was likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

ezyang added a commit that referenced this pull request Sep 26, 2023
Fixes #109871

Signed-off-by: Edward Z. Yang <ezyangmeta.com>

ghstack-source-id: 3dca993
Pull Request resolved: #110103
@ezyang ezyang added ciflow/trunk Trigger trunk jobs on your pull request release notes: composability release notes category topic: new features topic category labels Sep 26, 2023
def masked_select(fake_mode, func, self, mask):
if (
fake_mode.shape_env is None
or not fake_mode.shape_env.allow_dynamic_output_shape_ops
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I forget why we have this config (as opposed to dyn output shapes always being allowed when we have a shape env), but i'll read the code later - see we do the same for nonzero.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The reason is inductor currently chokes on this stuff, so we need to induce a graph break under default config. But #109893 should make it so we can start attempting to change the defaults here.

maxval = sys.maxsize - 1
if not free_symbols(arg.numel()):
if arg.numel() >= 2:
maxval = int(arg.numel())
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i wonder if this pattern will become common enough that we should util-ify it

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's definitely some design that needs to be thought through for upper bounds on symbolic sizes. We actually probably do want to track upper bounds that have symbolic symbols in them, for other reasons...

@ezyang
Copy link
Contributor Author

ezyang commented Sep 27, 2023

@pytorchbot merge -i

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged while ignoring the following 2 checks: pull / linux-focal-py3.8-clang10 / test (dynamo, 2, 2, linux.2xlarge), trunk / linux-focal-rocm5.6-py3.8 / test (default, 1, 3, linux.rocm.gpu)

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@facebook-github-bot facebook-github-bot deleted the gh/ezyang/2371/head branch September 30, 2023 14:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/inductor ciflow/trunk Trigger trunk jobs on your pull request Merged release notes: composability release notes category topic: new features topic category
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants