Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add possibility for downloading entire collections #4098

Merged
merged 5 commits into from Jun 5, 2017

Conversation

Projects
None yet
3 participants
@mvdbeek
Copy link
Member

commented May 22, 2017

Entire collections can now be downloaded as tarballs. I have used the
StreamBall class from galaxy.utils, so archives start downloading
immediately.

The collection structure is mapped onto a directory structure, where each
level of a collection is a directory in the archive. Collections of BAM
files are included alongside their .bai indices, and composite datatype
are supported as well.

API tests for downloading list, paired and list:paired collections are
included.

Currently collection elements that are not in the OK status are just
being skipped, so we should probably hide the download button if not all
collection elements are in a final state.

@bgruening

This comment has been minimized.

Copy link
Member

commented May 22, 2017

Amazing! Thanks a bunch!!!!

mvdbeek added some commits May 19, 2017

Add API route for downloading entire collections
Entire collections can now be downloaded as tarballs. I have used the
StreamBall class from galaxy.utils, so archives start downloading
immediately.

The collection structure is mapped onto a directory struture, where each
level of a collection is a directory in the archive.  Collections of BAM
files are included alongside their .bai indices, and composite datatype
are supported as well.

API tests for downloading list, paired and list:paired collections are
included.

Currently collection elements that are not in the OK status will be
skipped, so we should probably hide the download button if not all
collection elements are in a final state.
Fix the API tests for collection downloads
by waiting for the datasets to become ready.

@mvdbeek mvdbeek force-pushed the mvdbeek:download_collection branch from a863524 to 9db1cc4 May 22, 2017

@jmchilton jmchilton merged commit 9d1a382 into galaxyproject:dev Jun 5, 2017

0 of 5 checks passed

api test Test started.
Details
continuous-integration/travis-ci/pr The Travis CI build is in progress
Details
framework test Test started.
Details
integration test Test started.
Details
toolshed test Test started.
Details
@jmchilton

This comment has been minimized.

Copy link
Member

commented Jun 5, 2017

Tremendous - this is really awesome - thanks a ton!

@bgruening

This comment has been minimized.

Copy link
Member

commented Jun 5, 2017

@mvdbeek really nice! Reload next? :)

@mvdbeek mvdbeek deleted the mvdbeek:download_collection branch Jun 12, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.