-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Small bug fixes #10
Small bug fixes #10
Conversation
since now openfmri.org forwards to openneuro and we do not crawl that one (yet or ever)
Otherwise it just drops aggregated data for any other subdataset in the corresponding superdatasets
dataset='^', | ||
path=self.repo.path, | ||
update_mode='all', | ||
incremental=True) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@mih, what is currently a use case for having all "neighboring" subdatasets in superdatasets to loose their metadata whenever I aggregate without incremental=True
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@mih -- with incremental
which I have to use so other subdatasets do not loose their metadata, now tests fail (e.g. https://travis-ci.org/datalad/datalad-crawler/jobs/410135254) .
I think things need fix ups on datalad side so https://github.com/datalad/datalad/issues/2772 . Meanwhile I will fixup here by assuming that may be pruning of old objects would come in the same commit as updating them, so count would decrease ;-)
Codecov Report
@@ Coverage Diff @@
## master #10 +/- ##
==========================================
- Coverage 86.76% 86.74% -0.03%
==========================================
Files 50 50
Lines 4111 4112 +1
==========================================
Hits 3567 3567
- Misses 544 545 +1
Continue to review full report at Codecov.
|
will be merged if tests pass - need other fixes on top. |
ha ha -- I thought to submit crcns fix in a different PR but apparently has to come here, so here it comes! |
Foi |
incremental=True
while aggregating metadata for the subdataset all the way to the top. @mih please verify that this is expected (was not needed before). Without it it would drop metadata for any other present subdataset in the dataset's superdatasets