Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add @slow decorator to run tests on main #10057

Merged
merged 2 commits into from
Feb 28, 2022
Merged

Conversation

driazati
Copy link
Member

@driazati driazati commented Jan 25, 2022

This adds the infrastructure discussed in https://discuss.tvm.apache.org/t/rfc-ci-skip-slow-tests-on-prs/11910, but without affecting any tests. As we investigate reasons behind slow tests in CI, this decorator will allow us to move these to run only on main and not PRs after checking with all concerned parties.

To run slow tests on a PR, the PR body needs to have @ci run slow tests (or similar, see should_run_slow_tests.py) in it somewhere. Skipping slow tests is a positive-only check, so they have to be explicitly skipped rather than run (meaning that for local runs no workflow change is necessary, slow tests will run as before)

@Mousius
Copy link
Member

Mousius commented Jan 26, 2022

Hi @driazati,

Can you recreate your RFC in tvm-rfcs so we can move it towards being finalised? 😸

@driazati
Copy link
Member Author

Hi @driazati,

Can you recreate your RFC in tvm-rfcs so we can move it towards being finalised? 😸

done! apache/tvm-rfcs#55

Copy link
Contributor

@areusch areusch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

couple questions and one minor thing

python/tvm/testing/utils.py Show resolved Hide resolved
tests/scripts/should_run_slow_tests.py Show resolved Hide resolved
tests/scripts/should_run_slow_tests.py Show resolved Hide resolved
Copy link
Member

@Mousius Mousius left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

apache/tvm-rfcs#55 is now merged, I'm going to leave this with @areusch to merge if happy 😸

@github-actions
Copy link
Contributor

github-actions bot commented Feb 9, 2022

It has been a while since this PR was updated, @Mousius @driazati @areusch please leave a review or address the outstanding comments

@driazati
Copy link
Member Author

Rebased, can @areusch or @Mousius push to a branch to check the Jenkinsfile changes?

@Mousius
Copy link
Member

Mousius commented Feb 21, 2022

@driazati it looks like it's merge cornflakes this morning 😿 if you rebase I can kick off a branch build for you.

This adds the infrastructure discussed in https://discuss.tvm.apache.org/t/rfc-ci-skip-slow-tests-on-prs/11910, but without affecting any tests. As we investigate reasons behind [slow tests](https://gist.github.com/driazati/e009f09ff44c6bc91c4d95a8e17fd6f1) in CI, this decorator will allow us to move these to run only on `main` and not PRs after checking with all concerned parties.
@areusch
Copy link
Contributor

areusch commented Feb 28, 2022

thanks @driazati @Mousius !

pfk-beta pushed a commit to pfk-beta/tvm that referenced this pull request Apr 11, 2022
* Add @slow decorator to run tests on `main`

This adds the infrastructure discussed in https://discuss.tvm.apache.org/t/rfc-ci-skip-slow-tests-on-prs/11910, but without affecting any tests. As we investigate reasons behind [slow tests](https://gist.github.com/driazati/e009f09ff44c6bc91c4d95a8e17fd6f1) in CI, this decorator will allow us to move these to run only on `main` and not PRs after checking with all concerned parties.

* cleanup

Co-authored-by: driazati <driazati@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

None yet

3 participants