Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FASTQC fails with too little memory #378

Closed
alexhbnr opened this issue Apr 3, 2020 · 5 comments
Closed

FASTQC fails with too little memory #378

alexhbnr opened this issue Apr 3, 2020 · 5 comments
Labels
bug Something isn't working question Further information is requested small_fix

Comments

@alexhbnr
Copy link
Contributor

alexhbnr commented Apr 3, 2020

FASTQC fails with the following error message when being run after clipping:

Exception in thread "Thread-1" java.lang.OutOfMemoryError: GC overhead limit exceeded
        at java.lang.String.toCharArray(String.java:2899)
        at uk.ac.babraham.FastQC.Modules.PerBaseQualityScores.processSequence(PerBaseQualityScores.java:132)
        at uk.ac.babraham.FastQC.Analysis.AnalysisRunner.run(AnalysisRunner.java:89)
        at java.lang.Thread.run(Thread.java:748)

This might suggest that the amount of memory for this program should be increased to > 1GB.

Thanks,
Alex

jfy133 added a commit that referenced this issue Apr 3, 2020
@apeltzer
Copy link
Member

apeltzer commented Apr 4, 2020

Fixed in dev - can you check whether that helped?

@apeltzer apeltzer added the question Further information is requested label Apr 4, 2020
@alexhbnr
Copy link
Contributor Author

alexhbnr commented Apr 7, 2020

Thanks for the quick adaption. It now submits the job with more memory to SLURM, however, still fails with the same error message. If I ran it mainly and submit it with the same memory requirements, it magically works. According to the sacct output, it barely needed any memory, though:

   CPUTime     MaxRSS
---------- ----------
  00:02:31
  00:02:31    342844K

So I am wondering if I have some edge case files or something else breaks here.
Any ideas or suggestions? I am currently using FASTQC v0.11.8, in your docker file you state v0.11.9, but I doubt that it is the problem because for a subset of the samples it works totally fine.

@jfy133
Copy link
Member

jfy133 commented Apr 7, 2020

Could you point me privately which files you're trying, and I'll try it out myself to see if I see anything else.

I could also try changing the fastqc command to specifically define memory requirements with -Xmx

jfy133 added a commit that referenced this issue Apr 8, 2020
@jfy133 jfy133 mentioned this issue Apr 8, 2020
8 tasks
@jfy133
Copy link
Member

jfy133 commented Apr 8, 2020

@alexhbnr please try running your command with -r patch-fastqc. I now got your command to run successfully. I've made a PR into dev already, but it would be good for second replication.

@jfy133 jfy133 added bug Something isn't working small_fix labels Apr 8, 2020
@alexhbnr
Copy link
Contributor Author

alexhbnr commented Apr 8, 2020

This patch fixes the issue. Thanks for catching this, @jfy133 !

@alexhbnr alexhbnr closed this as completed Apr 8, 2020
lordkev pushed a commit to lordkev/eager that referenced this issue May 6, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working question Further information is requested small_fix
Projects
None yet
Development

No branches or pull requests

3 participants