-
Notifications
You must be signed in to change notification settings - Fork 12
Increasing max memory inside container? #31
Comments
I haven’t done it, but if you are able to figure out a solution, please open a PR for it, as I think at least GB would be useful.
https://stackoverflow.com/questions/29923531/how-to-set-java-heap-size-xms-xmx-inside-docker-container <https://stackoverflow.com/questions/29923531/how-to-set-java-heap-size-xms-xmx-inside-docker-container>
Nathan
… On Nov 27, 2018, at 3:45 AM, marchoeppner ***@***.***> wrote:
Hi,
I have been running the WA docker container successfully for some time. Now I wanted to implement a backup routine for the curation track of a vertebrate genome (> 20.000 models). I get a an out of memory error when doing this from outside the container using the groovy get_gff3.groovy script that is bundled with WA.
The machine has plenty RAM, but I think the tomcat server inside the docker container is configured with too little.
Since I have little experience with Docker - I can I increase the max memory available to Tomcat inside the container?
Cheers,
Marc
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub <#31>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAt2qsKTuAQviX1MjSoEWiaWKDZnvcQ1ks5uzSXzgaJpZM4Y1UaM>.
|
@marchoeppner Most likely you'll be updating the Might be worth posting to the Apollo list, though, as someone there has already done this. |
@hodgett are you sure its memory related? Can you show me the catalina.out and the javascript console? |
Where do I find these? |
Configuring Shiro ... Shiro Configured |
I don't know where to find catalina.out, the one on my host is zero length |
@hodgett In this case, what you are are seeing above is the
Thanks. |
From the system info I see; I would like to increase the total memory like I have seen in other apollo installs, 636Mb is way too small. The BAM file is 250Gb. Only this track is showing the error, the other tracks display fine in the same window. |
That bam size won’t necessarily affect memory. You need the chrome JavaScript console to see what the error is.
… On Mar 1, 2019, at 8:35 PM, hodgett ***@***.***> wrote:
From the system info I see;
Max memory | 6257.246208 MB
Free memory | 145.815840 MB
Available processors | 2
Total memory | 636.080128 MB
I would like to increase the total memory like I have seen in other apollo installs, 636Mb is way too small. The BAM file is 250Gb. Only this track is showing the error, the other tracks display fine in the same window.
{ "baiUrlTemplate" : "raw/NbRNASeq_AllS.sorted.bam.bai", "key" : "NbRNASeq_AllS.sorted", "label" : "NbRNASeq_AllS.sorted", "storeClass" : "JBrowse/Store/SeqFeature/BAM", "type" : "JBrowse/View/Track/Alignments2", "urlTemplate" : "raw/NbRNASeq_AllS.sorted.bam" }
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.
|
|
|
Looks like an error reading the index.
1. Does this happen for smaller BAM tracks?
2. Does this happen for EVERY scaffold?
3. Does this happen for standalone JBrowse?
I would download and install the latest version of JBrowse: http://jbrowse.org/ <http://jbrowse.org/>
And point it at that directory and see if you see the same error. (You should be able to do an ./setup.sh && npm start)
If the answer to #3 is yes, I would post the issue (and the command you used to generate it) to the mailing list or as a JBrowse issue (once you confirm it): http://jbrowse.org/contact.html <http://jbrowse.org/contact.html>
… On Mar 2, 2019, at 5:07 AM, hodgett ***@***.***> wrote:
tenacious-fetch.m.js:2 GET https://sefapps06.qut.edu.au/apollo/31/jbrowse/data/raw/NbRNASeq_AllS.sorted.bam.bai net::ERR_CONTENT_LENGTH_MISMATCH 200 t @ tenacious-fetch.m.js:2 (anonymous) @ tenacious-fetch.m.js:2 t @ tenacious-fetch.m.js:2 (anonymous) @ tenacious-fetch.m.js:2 getfetch @ XHRBlob.js:30 _callee$ @ XHRBlob.js:209 tryCatch @ runtime.js:65 invoke @ runtime.js:303 prototype.(anonymous function) @ runtime.js:117 step @ XHRBlob.js:3 (anonymous) @ XHRBlob.js:3 (anonymous) @ XHRBlob.js:3 fetchBufferPromise @ XHRBlob.js:235 _callee2$ @ BlobFilehandleWrapper.js:65 tryCatch @ runtime.js:65 invoke @ runtime.js:303 prototype.(anonymous function) @ runtime.js:117 step @ BlobFilehandleWrapper.js:3 (anonymous) @ BlobFilehandleWrapper.js:3 (anonymous) @ BlobFilehandleWrapper.js:3 readFile @ BlobFilehandleWrapper.js:76 _callee2$ @ bai.js:121 tryCatch @ runtime.js:62 invoke @ runtime.js:296 prototype.(anonymous function) @ runtime.js:114 step @ asyncToGenerator.js:17 (anonymous) @ asyncToGenerator.js:35 F @ _export.js:36 (anonymous) @ asyncToGenerator.js:14 parse @ bai.js:201 _tinyMemoized @ bai.js:408 _callee4$ @ bai.js:343 tryCatch @ runtime.js:62 invoke @ runtime.js:296 prototype.(anonymous function) @ runtime.js:114 step @ asyncToGenerator.js:17 (anonymous) @ asyncToGenerator.js:35 F @ _export.js:36 (anonymous) @ asyncToGenerator.js:14 hasRefSeq @ bai.js:368 hasRefSeq @ bamFile.js:650 constructor @ BAM.js:233 (anonymous) @ declare.js:426 (anonymous) @ Browser.js:1622 (anonymous) @ lang.js:385 contextRequire @ main.bundle.js:313 req @ main.bundle.js:212 getStore @ Browser.js:1613 renderTrack @ GenomeView.js:2069 (anonymous) @ GenomeView.js:177 (anonymous) @ lang.js:385 _normalizedCreator @ Container.js:343 _normalizedCreator @ Selector.js:155 insertNodes @ Container.js:192 insertNodes @ Selector.js:172 showTracks @ GenomeView.js:1857 (anonymous) @ lang.js:383 dispatcher @ aspect.js:101 on.emit @ on.js:344 on.emit @ on.js:385 emit @ Evented.js:32 publish @ topic.js:25 publish @ Browser.js:1724 (anonymous) @ Browser.js:2380 (anonymous) @ lang.js:385 (anonymous) @ Browser.js:1818 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ Browser.js:902 (anonymous) @ lang.js:385 signalListener @ Deferred.js:37 Deferred.then.promise.then @ Deferred.js:258 (anonymous) @ Browser.js:890 (anonymous) @ lang.js:385 (anonymous) @ Browser.js:1818 signalListener @ Deferred.js:37 Deferred.then.promise.then @ Deferred.js:258 afterMilestone @ Browser.js:1816 (anonymous) @ Browser.js:889 (anonymous) @ lang.js:385 (anonymous) @ Browser.js:1818 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ Browser.js:498 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:58 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 handleResponse @ xhr.js:81 onLoad @ xhr.js:116 load (async) addListeners @ xhr.js:144 xhr @ xhr.js:231 (anonymous) @ Browser.js:491 _milestoneFunction @ Browser.js:1792 loadRefSeqs @ Browser.js:448 (anonymous) @ Browser.js:88 signalListener @ Deferred.js:37 Deferred.then.promise.then @ Deferred.js:258 (anonymous) @ Browser.js:85 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ Browser.js:246 notify @ Deferred.js:187 complete @ Deferred.js:168 resolve.callback @ Deferred.js:248 addResult @ DeferredList.js:54 (anonymous) @ DeferredList.js:37 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ Browser.js:277 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ Browser.js:542 finish @ lazyload.js:114 pollWebKit @ lazyload.js:329 setTimeout (async) pollWebKit @ lazyload.js:338 setTimeout (async) pollWebKit @ lazyload.js:338 load @ lazyload.js:250 finish @ lazyload.js:116 pollWebKit @ lazyload.js:329 setTimeout (async) pollWebKit @ lazyload.js:338 load @ lazyload.js:250 css @ lazyload.js:367 _loadCSS @ Browser.js:541 (anonymous) @ Browser.js:269 forEach @ array.js:247 (anonymous) @ Browser.js:252 (anonymous) @ lang.js:385 contextRequire @ main.bundle.js:313 req @ main.bundle.js:212 (anonymous) @ Browser.js:249 _milestoneFunction @ Browser.js:1792 initPlugins @ Browser.js:191 (anonymous) @ Browser.js:83 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ Browser.js:1882 (anonymous) @ lang.js:385 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ all.js:69 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 (anonymous) @ Deferred.js:70 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ all.js:69 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 (anonymous) @ Deferred.js:70 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 (anonymous) @ all.js:69 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 (anonymous) @ Deferred.js:70 signalListener @ Deferred.js:37 Deferred.then.promise.then @ Deferred.js:258 signalListener @ Deferred.js:45 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:58 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 (anonymous) @ Deferred.js:70 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:58 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 handleResponse @ xhr.js:81 onLoad @ xhr.js:116 load (async) addListeners @ xhr.js:144 xhr @ xhr.js:231 load @ JB_json_v1.js:28 (anonymous) @ ConfigManager.js:144 signalListener @ Deferred.js:37 Deferred.then.promise.then @ Deferred.js:258 _loadInclude @ ConfigManager.js:141 (anonymous) @ ConfigManager.js:123 _loadRecur @ ConfigManager.js:121 (anonymous) @ ConfigManager.js:124 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:58 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 (anonymous) @ Deferred.js:70 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:58 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 handleResponse @ xhr.js:81 onLoad @ xhr.js:116 load (async) addListeners @ xhr.js:144 xhr @ xhr.js:231 load @ JB_json_v1.js:28 (anonymous) @ ConfigManager.js:144 signalListener @ Deferred.js:37 Deferred.then.promise.then @ Deferred.js:258 _loadInclude @ ConfigManager.js:141 (anonymous) @ ConfigManager.js:123 _loadRecur @ ConfigManager.js:121 (anonymous) @ ConfigManager.js:124 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:58 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 (anonymous) @ Deferred.js:70 signalListener @ Deferred.js:37 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:58 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 signalDeferred @ Deferred.js:81 signalListener @ Deferred.js:52 signalWaiting @ Deferred.js:28 Deferred.resolve @ Deferred.js:192 handleResponse @ xhr.js:81 onLoad @ xhr.js:116 load (async) addListeners @ xhr.js:144 xhr @ xhr.js:231 load @ JB_json_v1.js:28 (anonymous) @ ConfigManager.js:144 signalListener @ Deferred.js:37 Deferred.then.promise.then @ Deferred.js:258 _loadInclude @ ConfigManager.js:141 (anonymous) @ ConfigManager.js:123 _loadRecur @ ConfigManager.js:121 _loadIncludes @ ConfigManager.js:135 (anonymous) @ ConfigManager.js:48 getFinalConfig @ ConfigManager.js:62 (anonymous) @ Browser.js:1860 _milestoneFunction @ Browser.js:1792 loadConfig @ Browser.js:1846 (anonymous) @ Browser.js:73 callback @ ready.js:121 onEvent @ ready.js:47 processQ @ domReady.js:49 detectReady @ domReady.js:62
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <#31 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAt2qqBW3ASn-d18cYt7qWj101O_BYRXks5vSneigaJpZM4Y1UaM>.
|
I'm going to close this for now. Moving the original scope to #42 |
But feel free to re-open if still an issue. |
Hi,
I have been running the WA docker container successfully for some time. Now I wanted to implement a backup routine for the curation track of a vertebrate genome (> 20.000 models). I get a an out of memory error when doing this from outside the container using the groovy get_gff3.groovy script that is bundled with WA.
The machine has plenty RAM, but I think the tomcat server inside the docker container is configured with too little.
Since I have little experience with Docker - can I somwhow increase the max memory available to Tomcat inside the container?
Cheers,
Marc
The text was updated successfully, but these errors were encountered: