Skip to content

Fix testing assumption - do create pure GitRepo superdataset and test against it - #7353

Merged
yarikoptic merged 3 commits into
datalad:maintfrom
yarikoptic:bf-convoluted-test
Mar 24, 2023
Merged

yarikoptic merged 3 commits into
datalad:maintfrom
yarikoptic:bf-convoluted-test

Conversation

@yarikoptic

Copy link
Copy Markdown
Member

While preparing unittest to demonstrate #7351 problem I found that the good old "parametric" test copied long time from revolution was actually not parametrized at all and thus pretty much causing running the same testing (with AnnexRepo) twice. This PR in this shape just fixes that and must not result in new failures.

As a result we do get differential timing for those two tests:

11.45s call     datalad/support/tests/test_repo_save.py::test_annexrepo_save_all
8.14s call     datalad/support/tests/test_repo_save.py::test_gitrepo_save_all

from original idential

13.86s call     datalad/support/tests/test_repo_save.py::test_gitrepo_save_all
13.83s call     datalad/support/tests/test_repo_save.py::test_annexrepo_save_all

;)

otherwise there is no point of having two tests - one for
GitRepo and one for AnnexRepo
…aset.create

otherwise it becomes an AnnexRepo and thus behaving pretty much the same way
as in AnnexRepo test and actually test running the same duration. With this change we get

11.45s call     datalad/support/tests/test_repo_save.py::test_annexrepo_save_all
8.14s call     datalad/support/tests/test_repo_save.py::test_gitrepo_save_all

thus attesting to the fact that we get different testing for GitRepo case

@bpoldrack bpoldrack left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops.

Thx!

@yarikoptic yarikoptic added the semver-tests Changes only affect tests, no impact on version label Mar 24, 2023
@yarikoptic

Copy link
Copy Markdown
Member Author

appveyor was a rare now flaky

FAILED ../datalad/support/tests/test_parallel.py::test_gracefull_death - assert 20 >= 24

I will add changelog and merge. I don't see codecov results - but I would expect it to increase if anything

@yarikoptic yarikoptic added the CHANGELOG-missing When a PR's description does not contain a changelog item, yet. label Mar 24, 2023
@github-actions github-actions Bot removed the CHANGELOG-missing When a PR's description does not contain a changelog item, yet. label Mar 24, 2023
@yarikoptic
yarikoptic merged commit e9a0148 into datalad:maint Mar 24, 2023
@yarikoptic-gitmate

Copy link
Copy Markdown
Collaborator

PR released in 0.18.3

@yarikoptic
yarikoptic deleted the bf-convoluted-test branch November 27, 2023 16:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

semver-tests Changes only affect tests, no impact on version

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants