Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BFD download bottleneck #13

Closed
georgkempf opened this issue Jul 16, 2021 · 3 comments
Closed

BFD download bottleneck #13

georgkempf opened this issue Jul 16, 2021 · 3 comments

Comments

@georgkempf
Copy link

Hi,
this is not really an issue with the code but it seems that downloading the BFD database is a real bottleneck (at least for me). I tried aria2c and wget and with both I only get around 200 kb/s download rate. It is certainly not a limit of bandwidth on my side. Estimated time of completion is 9d! Does anyone maybe have the file mirrored?

@ioioba
Copy link

ioioba commented Jul 16, 2021

Same for me. I get around 6000 kb/s in the first minute and then it continuously goes down to 80 - 200 kb/s ... estimated time of completion is 25d! :D

@tjonesster
Copy link

Encountering the same issue. The dataset is licensed under the CC BY 4.0 license so redistribution is allowed. Can someone with a complete copy set up a torrent so that we can seed for one another?

@tfgg
Copy link
Collaborator

tfgg commented Jul 16, 2021

Edit: We've now updated the download script for BFD to use our mirror. Please update and use that.

Hi, we've set up a mirror on cloud storage here:

https://storage.googleapis.com/alphafold-databases/casp14_versions/bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt.tar.gz

Please try using it in your download script.

This link makes available:
BFD (unmodified), by Steinegger M. and Söding J., available under a Creative Commons Attribution-ShareAlike 4.0 International License.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants