Exit code returned to console does not reflect failure status when running multiple environments #2945
Labels
help:wanted
Issues that have been acknowledged, a solution determined and a PR might likely be accepted.
Issue
When running a single environment, tox correctly reports the exit code back to the calling shell
cmd.exe
:> tox run -e py310-ok 1>NUL 2>NUL & if ERRORLEVEL 1 echo FAIL >
However, when multiple environments are run, independent of individual results, the error code always indicates "OK"
> tox run -e py310-ok,py310-fail 1>NUL 2>NUL & if ERRORLEVEL 1 echo FAIL >
> tox run -e py310-fail,py310-fail2 1>NUL 2>NUL & if ERRORLEVEL 1 echo FAIL >
Expected behaviour:
If at least one run fails, that should be reflected in the return code:
Of course, if all succeed, that should also be correctly transported:
> tox run -e py310-ok,py310-ok2 1>NUL 2>NUL & if ERRORLEVEL 1 echo FAIL >
Environment
pip list
of the host Python wheretox
is installed:(tox is installed via
pipx
and is not in that environment).Minimal example
I made the effort to set up a minimal example. Feel free to peruse it:
See this gist
The text was updated successfully, but these errors were encountered: