New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use dask.store to save a catalog. #544

Merged
merged 7 commits into from Jan 2, 2019

Conversation

Projects
None yet
1 participant
@rainwoodman
Copy link
Member

rainwoodman commented Dec 30, 2018

The method is recommended by dask devs for storing data to disk. It will prioritize disk write operations, avoiding some issues seen with the map_blocks method. Also may fix a problem about rechunking that @modichirag has been seeing with the HiddenValley simulations.

@rainwoodman rainwoodman merged commit 4dbf2e3 into bccp:master Jan 2, 2019

2 checks passed

continuous-integration/travis-ci/pr The Travis CI build passed
Details
coverage/coveralls Coverage increased (+0.007%) to 94.703%
Details

@rainwoodman rainwoodman deleted the rainwoodman:store-catalog branch Jan 2, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment