-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Very high memory usage when realigning #27
Comments
Right now, the main limitation of vcfdist is memory usage. It isn't related to genome or VCF size, but scales quadratically with the size of the largest cluster. What is the largest variant in the VCF? If it's pretty large, I would recommend limiting the max size with |
Currently I am using Here is an example of a failing sample (they're all failing for all samples to be honest). I ran vcfdist from the v2.5.1 docker image with the following command
Let me know if you need anything else. I should say, without the realign flags (and v2.3.3) this used no more than 500MB of memory |
Thanks for sending over the test data! I was able to reproduce your error with large RAM usage, but found the culprit to actually be the optional I'm looking into it now. |
This was caused by an indexing error in |
Amazing! Thanks for the quick turnaround. Gotta love bug hunting (I do at least). |
Using v2.5.1, when I use the
--realign-truth --realign-query
options I am getting crazy high memory usage. This is for a bacterial sample, so the genome is ~4MB and the VCF is of negligible size. So far I have had all my jobs fail when requesting 64GB of memory on our cluster. This seems much too high right?The text was updated successfully, but these errors were encountered: