Skip to content

Conversation

XilunWu
Copy link
Contributor

@XilunWu XilunWu commented Aug 18, 2023

@pytorch-bot
Copy link

pytorch-bot bot commented Aug 18, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/107440

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 88af451 with merge base 884c03d (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

XilunWu added a commit that referenced this pull request Aug 18, 2023
ghstack-source-id: fcc06d8
Pull Request resolved: #107440
@XilunWu XilunWu added ciflow/trunk Trigger trunk jobs on your pull request release notes: distributed (dtensor) release notes category labels Aug 18, 2023
Copy link
Contributor

@fduwjj fduwjj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wondering why this was not captured by the lint rule (mypy for example)..

Copy link
Collaborator

@wanchaol wanchaol left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add the randn too (either in this PR or in follow up PRs)?

@XilunWu
Copy link
Contributor Author

XilunWu commented Aug 21, 2023

Wondering why this was not captured by the lint rule (mypy for example)..

same question!! I was quite surprised when finding the it. Should I report this to dev team? @wanchaol @fduwjj

@XilunWu
Copy link
Contributor Author

XilunWu commented Aug 21, 2023

Can you add the randn too (either in this PR or in follow up PRs)?

will do in another PR

@XilunWu
Copy link
Contributor Author

XilunWu commented Aug 21, 2023

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@XilunWu XilunWu deleted the gh/XilunWu/44/head branch August 21, 2023 17:21
summerdo pushed a commit to summerdo/pytorch that referenced this pull request Aug 23, 2023
…ytorch#105021)

I found that the upsample bicubic lowering was generating this line

```python
ops.index_expr(0.244094488188976*x0, torch.float32)
```

which is not good because triton's `ops.index_expr` expects integer expressions and dtypes.

Pull Request resolved: pytorch#105021
Approved by: https://github.com/lezcano

[Compiled Autograd] Improve nyi error messages (pytorch#106176)

Pull Request resolved: pytorch#106176
Approved by: https://github.com/eellison

benchmark: convert output of fp64 to torch.float64 (pytorch#107375)

This PR adds converting the output of fp64 to torch.float64 before checking for accuracy.

Why we need this change?
For llama of torchbench, it converts output to float before returning it.
https://github.com/pytorch/benchmark/blob/bad4e9ac19852f320c0d21e97f526e0c2838633e/torchbenchmark/models/llama/model.py#L241

While in the correctness checker, it will not compare the res results with fp64_ref if the fp64_ref.dtype is not torch.float64. So llama fails the accuracy check in the low-precision case, even though res is closer to fp64_ref than ref.
https://github.com/pytorch/pytorch/blob/e108f33299e4ea8fd39a1a81cf5ba6f3b509b6cb/torch/_dynamo/utils.py#L1025

Pull Request resolved: pytorch#107375
Approved by: https://github.com/jgong5, https://github.com/XiaobingSuper, https://github.com/jansel

benchmark: higher tolerance for RobertaForQuestionAnswering (pytorch#107376)

Pull Request resolved: pytorch#107376
Approved by: https://github.com/kit1980, https://github.com/XiaobingSuper, https://github.com/jansel
ghstack dependencies: pytorch#107375

remove unnecessary import introduced in PR 106535 (pytorch#107440)

Pull Request resolved: pytorch#107440
Approved by: https://github.com/fduwjj
ghstack dependencies: pytorch#106535

Don't use thrust::log(complex) in CUDA as it takes a FOREVER to compile (pytorch#107559)

As per title
Pull Request resolved: pytorch#107559
Approved by: https://github.com/peterbell10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk Trigger trunk jobs on your pull request Merged release notes: distributed (dtensor) release notes category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants