Skip to content

Enhancement/combine MergeBams and MarkDuplicates#875

Merged
anoronh4 merged 12 commits intodevelopfrom
enhancement/combine_merge_markduplicates
Feb 9, 2021
Merged

Enhancement/combine MergeBams and MarkDuplicates#875
anoronh4 merged 12 commits intodevelopfrom
enhancement/combine_merge_markduplicates

Conversation

@anoronh4
Copy link
Copy Markdown
Collaborator

@anoronh4 anoronh4 commented Feb 5, 2021

MergeBams and MarkDuplicates were combined into a single process named MergeBamsAndMarkDuplicates. This is expected to reduce the size of the bam cache because the merged and unmarked bam is not written to permanent storage. The resource configuration files were adjusted by simply adopted the resources for MarkDuplicates. The container for MergeBams became the container of the new process because it also contains gatk.

i noticed that the original resources_juno_genome.config had 8 cpu* 1.GB for MergeBams, is there a reason it needs so many cpu for the combined process or will 2 cpu*5.GB cover it?

Comment thread pipeline.nf
Comment thread conf/resources_juno_genome.config Outdated
Comment thread conf/containers.config Outdated
@gongyixiao gongyixiao self-requested a review February 6, 2021 08:07
Copy link
Copy Markdown
Collaborator

@gongyixiao gongyixiao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left a few comments here.

@gongyixiao gongyixiao changed the title combine MergeBams and MarkDuplicates Enhancement/combine MergeBams and MarkDuplicates Feb 6, 2021
@anoronh4 anoronh4 force-pushed the enhancement/combine_merge_markduplicates branch from 8426eed to 8714be0 Compare February 7, 2021 15:17
@anoronh4 anoronh4 requested a review from gongyixiao February 7, 2021 17:20
@gongyixiao gongyixiao added the enhancement New feature or request label Feb 8, 2021
@gongyixiao gongyixiao added this to the 1.4 milestone Feb 8, 2021
@anoronh4 anoronh4 merged commit d00e839 into develop Feb 9, 2021
@anoronh4 anoronh4 deleted the enhancement/combine_merge_markduplicates branch July 20, 2021 14:25
@gongyixiao gongyixiao mentioned this pull request Aug 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants