New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speed up the dag building process #12

Open

alexg9010 opened this issue Mar 27, 2018 · 0 comments

Labels

enhancement wishlist

Member

alexg9010 commented Mar 27, 2018

For the ChIPseq pipeline I had the feeling that the dag building took way too long for the dry-run (in total around 250 jobs), so I started searching a bit around and found this to be not only the case for me as it seems to be a general issue for larger number of jobs (https://bitbucket.org/snakemake/snakemake/issues/534/dryrun-takes-a-long-time-for-complex).
One thing that I found that we (as developers) could improve is to use less wildcards and rather reuse the outputs of dependent rules (https://bitbucket.org/snakemake/snakemake/issues/745/building-dag-of-jobs-slower).

This is something that definitely is not urgent, but we might want to change this at some point.

alexg9010 added enhancement wishlist labels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment