Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Nova] Disable Linux Wheels Builds from CircleCI #6954

Merged
merged 2 commits into from
Nov 21, 2022

Conversation

osalpekar
Copy link
Member

@osalpekar osalpekar commented Nov 15, 2022

Nova binary build workflows have been running smoothly on trunk for a few weeks, so we are proceeding with the switch to Nova by disabling the corresponding builds from CircleCI. This PR starts this process by disabling Linux Wheels builds from CircleCI. We'll keep around the py.37 Linux Wheels jobs since docs builds depend on this, but that job will not upload any binaries. For all the other python/cuda versions, the Linux Wheels jobs will be disabled. We hope to migrate docs builds in the future as well, at which point the py3.7 linux wheels build will also be disabled.

cc @seemethere

@pmeier
Copy link
Collaborator

pmeier commented Nov 16, 2022

We hope to migrate docs builds in the future as well, at which point the py3.7 linux wheels build will also be disabled.

One strong reason for using CircleCI to build the docs, is that it allows us to host the generated HTML in the process. For example, you can find the docs built by this PR here: https://output.circle-artifacts.com/output/job/5083e59e-509d-4137-9f78-6a175f3e1d63/artifacts/0/docs/index.html. This makes it really easy to asses the impact of a PR on our documentation.

Is something like this available for GHA? I know you can upload the artifacts, but I've never seen it being able to host the HTML. If not, can we maybe keep the docs workflow on CircleCI?

@osalpekar
Copy link
Member Author

@pmeier Sure, we can keep the docs builds on CircleCI until we have a good alternative. Exploring docs migration was anyways planned for sometime next year.

@osalpekar
Copy link
Member Author

@datumbox @pmeier Any other concerns for this PR? Regarding any queueing issues - we can definitely flag that to our teammates working on the CI cluster

Copy link
Collaborator

@pmeier pmeier left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One comment below, otherwise no concerns from my side. Thanks Omkar!

For all other reviewers that might wonder why there is no change to .circleci/config.yml.in: the only change is inside the generation logic and thus we build a different .circleci/config.yml from the same template. Workflow that checks consistency of the two files is green: https://app.circleci.com/pipelines/github/pytorch/vision/21978/workflows/7e9d4ce5-9033-493a-92ff-9d273e48f7c5/jobs/1779312

@@ -40,7 +40,7 @@ jobs:
smoke-test-script: ${{ matrix.smoke-test-script }}
# Using "development" as trigger event so these binaries are not uploaded
# to official channels yet
trigger-event: development
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm guessing this is the change that actually uploads the wheels from GHA rather than from CircleCI, right? In any case, could you please remove the comment above this line, since it is no longer valid?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah yes - great point!

@osalpekar osalpekar merged commit 4a310f2 into pytorch:main Nov 21, 2022
@github-actions
Copy link

Hey @osalpekar!

You merged this PR, but no labels were added. The list of valid labels is available at https://github.com/pytorch/vision/blob/main/.github/process_commit.py

facebook-github-bot pushed a commit that referenced this pull request Nov 24, 2022
Summary:
* [Nova] Disable Linux Wheels Builds from CircleCI

* remove old comment

Reviewed By: YosuaMichael

Differential Revision: D41518192

fbshipit-source-id: 07d69aad67f530a634929d9f85bb569f3b6ebe06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants