Skip to content

Conversation

drisspg
Copy link
Contributor

@drisspg drisspg commented Feb 10, 2023

Summary

This PR made some significant changes to the scripts around Release Scripts. At a high level:

  • Turned the quips into docs and updated links
  • Update the common.categorizes list in the hopes to make this the source of truth for releases- This is hard since the release_notes labels can be changed at will. An alternative would be to poll from github api. However, I think that is overkill. The notebook does a set compare and will show you knew categories. I think we want this to be manual so that the release note engineer will decided how to categorize.
  • Create cateogry group from speaking with folks on distributed and AO that told me these different release categories can be merged.
  • I am the newest person to Core and don't use ghstack soo made token getting a lil more generic.
  • Added a classifier.py file. This file will train a commit categorizer for you, hopefully with decent accuracy. I was able to achieve 75% accuracy. I drop the highest frequency class - "skip" since this creates a more useful cateogrizer.
  • I updated the categorize.py script so that the prompt will be what the classifier thinks, gated by a flag.
  • Added a readme that will hopefully help future release notes engineers.

cc @soumith @voznesenskym @yanboliang @penguinwu @anijain2305 @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @Xia-Weiwen @wenzhe-nrv @jiayisunx @peterbell10 @desertfire

@pytorch-bot
Copy link

pytorch-bot bot commented Feb 10, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/94560

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 Failures

As of commit c856437:

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Feb 10, 2023
@drisspg drisspg changed the title Updates to the release nots scripts and documentation Updates to the release notes scripts and documentation Feb 10, 2023
@drisspg drisspg force-pushed the changes_to_release_note_scripts branch 6 times, most recently from 5aa6ee0 to a6dca4f Compare February 16, 2023 23:09
@pytorch-bot pytorch-bot bot added ciflow/mps Run MPS tests (subset of trunk) labels Feb 16, 2023
@drisspg drisspg force-pushed the changes_to_release_note_scripts branch 2 times, most recently from e23184d to 91e3757 Compare February 21, 2023 23:02
@drisspg drisspg marked this pull request as ready for review February 21, 2023 23:33
@drisspg drisspg force-pushed the changes_to_release_note_scripts branch 3 times, most recently from c931072 to d2d6a8e Compare February 28, 2023 01:45
@drisspg drisspg force-pushed the changes_to_release_note_scripts branch from d2d6a8e to f6573d5 Compare March 9, 2023 19:33
@drisspg drisspg added the better-engineering Relatively self-contained tasks for better engineering contributors label Mar 14, 2023
@drisspg drisspg force-pushed the changes_to_release_note_scripts branch from f6573d5 to 4234566 Compare March 14, 2023 20:59
@drisspg drisspg requested a review from albanD March 14, 2023 20:59
Copy link
Collaborator

@albanD albanD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Didn't go through all of this in detail but sounds good. I'm sure you'll guide the next person having to use this!

file_embedding_dim: int = 32


class CommitClassifier(nn.Module):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we replace this with the openai API for chatgpt? :D

@drisspg
Copy link
Contributor Author

drisspg commented Mar 15, 2023

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Mar 15, 2023
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@pytorchmergebot
Copy link
Collaborator

Merge failed

Reason: 1 mandatory check(s) failed. The first few are:

Dig deeper by viewing the failures on hud

Details for Dev Infra team Raised by workflow job

Failing merge rule: Core Maintainers

@drisspg
Copy link
Contributor Author

drisspg commented Mar 16, 2023

@pytorchbot merge -f "flaky tests"

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 23, 2023
# Summary
This PR made some significant changes to the scripts around Release Scripts. At a high level:
- Turned the quips into docs and updated links
- Update the common.categorizes list in the hopes to make this the source of truth for releases- This is hard since the release_notes labels can be changed at will. An alternative would be to poll from github api. However, I think that is overkill. The notebook does a set compare and will show you knew categories. I think we want this to be manual so that the release note engineer will decided how to categorize.
- Create cateogry group from speaking with folks on distributed and AO that told me these different release categories can be merged.
- I am the newest person to Core and don't use ghstack soo made token getting a lil more generic.
- Added a classifier.py file. This file will train a commit categorizer for you, hopefully with decent accuracy. I was able to achieve 75% accuracy. I drop the highest frequency class - "skip" since this creates a more useful cateogrizer.
- I updated the categorize.py script so that the prompt will be what the classifier thinks, gated by a flag.
- Added a readme that will hopefully help future release notes engineers.

Pull Request resolved: pytorch/pytorch#94560
Approved by: https://github.com/albanD
cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 27, 2023
# Summary
This PR made some significant changes to the scripts around Release Scripts. At a high level:
- Turned the quips into docs and updated links
- Update the common.categorizes list in the hopes to make this the source of truth for releases- This is hard since the release_notes labels can be changed at will. An alternative would be to poll from github api. However, I think that is overkill. The notebook does a set compare and will show you knew categories. I think we want this to be manual so that the release note engineer will decided how to categorize.
- Create cateogry group from speaking with folks on distributed and AO that told me these different release categories can be merged.
- I am the newest person to Core and don't use ghstack soo made token getting a lil more generic.
- Added a classifier.py file. This file will train a commit categorizer for you, hopefully with decent accuracy. I was able to achieve 75% accuracy. I drop the highest frequency class - "skip" since this creates a more useful cateogrizer.
- I updated the categorize.py script so that the prompt will be what the classifier thinks, gated by a flag.
- Added a readme that will hopefully help future release notes engineers.

Pull Request resolved: pytorch/pytorch#94560
Approved by: https://github.com/albanD
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

better-engineering Relatively self-contained tasks for better engineering contributors ciflow/inductor ciflow/mps Run MPS tests (subset of trunk) ciflow/trunk Trigger trunk jobs on your pull request Merged module: inductor topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants