Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use pytest-xdist to run pytest in parallel #33825

Closed
mkoeppe opened this issue May 9, 2022 · 16 comments
Closed

Use pytest-xdist to run pytest in parallel #33825

mkoeppe opened this issue May 9, 2022 · 16 comments

Comments

@mkoeppe
Copy link
Member

mkoeppe commented May 9, 2022

(from #33546 comment:13 - #33546 comment:20)

Use https://github.com/pytest-dev/pytest-xdist to run pytest in parallel.

CC: @tobiasdiez

Component: doctest framework

Author: Tobias Diez

Branch/Commit: a2e396b

Reviewer: Dima Pasechnik, Matthias Koeppe

Issue created by migration from https://trac.sagemath.org/ticket/33825

@mkoeppe mkoeppe added this to the sage-9.7 milestone May 9, 2022
@tobiasdiez
Copy link
Contributor

Branch: public/build/pytest-xdist

@tobiasdiez
Copy link
Contributor

New commits:

4290b11Add pytest-xdist package

@tobiasdiez
Copy link
Contributor

Commit: 4290b11

@tobiasdiez
Copy link
Contributor

Changed dependencies from #33546 to none

@tobiasdiez

This comment has been minimized.

@tobiasdiez tobiasdiez changed the title Use pytest-parallel or pytest-xdist to run pytest in parallel Use pytest-xdist to run pytest in parallel May 14, 2022
@dimpase
Copy link
Member

dimpase commented May 14, 2022

comment:3

lgtm

@dimpase
Copy link
Member

dimpase commented May 14, 2022

Author: Tobias Diez

@dimpase
Copy link
Member

dimpase commented May 14, 2022

Reviewer: Dima Pasechnik

@tobiasdiez
Copy link
Contributor

comment:4

That was quick, thanks!

@mkoeppe
Copy link
Member Author

mkoeppe commented May 14, 2022

comment:5

All packages that appear as requirements for which we have an entry in build/pkgs/ should be listed in dependencies. This is to avoid races

[pytest_xdist] Requirement already satisfied: pytest>=6.2.0 in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (7.1.2)
[pytest_xdist] Requirement already satisfied: pluggy<2.0,>=0.12 in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from pytest>=6.2.0->pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (1.0.0)
[pytest_xdist] Requirement already satisfied: py>=1.8.2 in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from pytest>=6.2.0->pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (1.10.0)
[pytest_xdist] Requirement already satisfied: iniconfig in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from pytest>=6.2.0->pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (1.1.1)
[pytest_xdist] Requirement already satisfied: attrs>=19.2.0 in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from pytest>=6.2.0->pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (21.2.0)
[pytest_xdist] Requirement already satisfied: tomli>=1.0.0 in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from pytest>=6.2.0->pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (1.2.1)
[pytest_xdist] Requirement already satisfied: packaging in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from pytest>=6.2.0->pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (21.3)
[pytest_xdist] Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /Users/mkoeppe/s/sage/sage-rebasing/local/var/lib/sage/venv-python3.10/lib/python3.10/site-packages (from packaging->pytest>=6.2.0->pytest-xdist->-r /Users/mkoeppe/s/sage/sage-rebasing/build/pkgs/pytest_xdist/requirements.txt (line 1)) (3.0.6)

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 14, 2022

Branch pushed to git repo; I updated commit sha1. New commits:

a365828build/pkgs/pytest/dependencies: Add missing dep
a2e396bbuild/pkgs/pytest_xdist/dependencies: Add missing dep

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 14, 2022

Changed commit from 4290b11 to a2e396b

@mkoeppe
Copy link
Member Author

mkoeppe commented May 14, 2022

Changed reviewer from Dima Pasechnik to Dima Pasechnik, Matthias Koeppe

@mkoeppe
Copy link
Member Author

mkoeppe commented May 14, 2022

comment:8

Follow-up: #33851

@tobiasdiez
Copy link
Contributor

comment:9

Thanks for adding the deps.

@vbraun
Copy link
Member

vbraun commented May 22, 2022

Changed branch from public/build/pytest-xdist to a2e396b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants