Skip to content

Conversation

mxschmitt
Copy link
Member

@mxschmitt mxschmitt commented Mar 10, 2025

This PR changes our assumption from marking individual tests as flaky to marking the whole test run as flaky and retrying all the tests if needed. It replaces the flaky plugin with rerunfailures plugin (maintained by the pytest org) since its not compatible with each-other. This aligns it how we do it in Node.js.

It enables 3 retries only for CI runs.

@mxschmitt mxschmitt force-pushed the migrate-from-flaky-to-rerunfailures branch from c19f37c to ed48b33 Compare March 10, 2025 09:34
@@ -49,5 +49,5 @@ jobs:
docker exec "${CONTAINER_ID}" pip install -r requirements.txt
docker exec "${CONTAINER_ID}" pip install -e .
docker exec "${CONTAINER_ID}" python -m build --wheel
docker exec "${CONTAINER_ID}" xvfb-run pytest -vv tests/sync/
docker exec "${CONTAINER_ID}" xvfb-run pytest -vv tests/async/
docker exec "${CONTAINER_ID}" xvfb-run pytest tests/sync/
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

drive-by: we set -vv already in our setup.cfg.

@yury-s yury-s merged commit 25fb05d into microsoft:main Mar 10, 2025
40 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants