Fix pytest-xdist with session-scoped fixture #94
Labels
1 - refactor
DRY conflict. Refactor required
1 - tests
A Failed test or tests needs updating
4 - back-burner
Item on hold, low priority
Currently, it is not possible to use more than
--numprocessor=1
as withpytest-xdist
the session scope is actually replicated and it does multiple loads of the data in fixture per worker.There are ways to overcome this with code examples found here, but since we load a mix of
numpy
files andtf.data.Prefectdataset
, it becomes a little complicated which for now doesn't really matter.With this issue fix, tests will surely be able to run fast as we can then run in parallel, but for now must be run with single worker, otherwise there is sure to be memory problems
Refs:
The text was updated successfully, but these errors were encountered: