Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add --retry=10 option to handle network failures for prepare_regions.sh #12

Open
youngchanpark opened this issue May 20, 2021 · 0 comments

Comments

@youngchanpark
Copy link
Member

During download of some data files in a prepare_regions.sh run, the download may fail not due to the bash code, but because of a temporary network failure.
For example:

./prepare-regions -o /my/output/directory

Output

Downloading cell type : hepatocyte
Downloading cell type : iPS_15b
Downloading cell type : iPS_20b
Downloading cell type : iPS_DF_19_11
Downloading cell type : iPS_DF_6_9
Downloading cell type : keratinocyte
Downloading cell type : kidney
Downloading cell type : large_intestine
[Error] At this step something failed. The file was not created! /my/output/directory/prepare_regions_tempfiles/2021.05.06/EnsemblRegulation/large_intestine.gff.gz
[Error] Exiting.

Rerunning with the -r (reuse) option successfully completed till the end.

./prepare-regions -r -o /my/output/directory

@agilly suggested that we should add a retry option which attempts to retry downloading the failed file, so that we don't need to rerun with the -r option.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant