Indexing multiple attachments gives java.lang.OutOfMemoryError: Java heap space

[meghuizen]

Indexing multiple attachments gives java.lang.OutOfMemoryError: Java heap space.

I add multiple attachments to the search index and it gives me this. Even on searching after I added these attachments, it gives me the same error on search. I think it has something te do with indexing the attachment itself.

The command to run elasticsearch:

/usr/bin/java -Xms256m -Xmx1g -Xss128k -Djline.enabled=true -XX:+AggressiveOpts -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/opt/elasticsearch-0.11.0/work/heap -Delasticsearch -Des.path.home=/opt/elasticsearch-0.11.0 -Des-foreground=yes -cp :/opt/elasticsearch-0.11.0/lib/elasticsearch-0.11.0.jar:/opt/elasticsearch-0.11.0/lib/*:/opt/elasticsearch-0.11.0/lib/sigar/* org.elasticsearch.bootstrap.Bootstrap

environment info:
root@myserver:# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 9.10
Release: 9.10
Codename: karmic
root@app1:# uname -a
Linux myserver 2.6.31-22-server #65-Ubuntu SMP Thu Sep 16 16:33:54 UTC 2010 x86_64 GNU/Linux
root@myserver:~# /usr/bin/java -version
java version "1.6.0_20"
Java(TM) SE Runtime Environment (build 1.6.0_20-b02)
Java HotSpot(TM) 64-Bit Server VM (build 16.3-b01, mixed mode)

JAVA backtrace:
java.lang.OutOfMemoryError: Java heap space
Dumping heap to /opt/elasticsearch-0.11.0/work/heap ...
Heap dump file created [1033493546 bytes in 4.057 secs]
Exception in thread "elasticsearch[Captain Atlas‎][tp]-pool-2-thread-9" java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:3209)
at java.lang.String.(String.java:215)
at java.lang.StringBuilder.toString(StringBuilder.java:430)
at org.elasticsearch.common.jackson.util.TextBuffer.contentsAsString(TextBuffer.java:329)
at org.elasticsearch.common.jackson.impl.JsonParserBase.getText(JsonParserBase.java:294)
at org.elasticsearch.common.xcontent.json.JsonXContentParser.text(JsonXContentParser.java:74)
at org.elasticsearch.index.mapper.xcontent.XContentStringFieldMapper.parseCreateField(XContentStringFieldMapper.java:137)
at org.elasticsearch.index.mapper.xcontent.XContentStringFieldMapper.parseCreateField(XContentStringFieldMapper.java:40)
at org.elasticsearch.index.mapper.xcontent.XContentFieldMapper.parse(XContentFieldMapper.java:282)
at org.elasticsearch.index.mapper.xcontent.XContentObjectMapper.serializeValue(XContentObjectMapper.java:414)
at org.elasticsearch.index.mapper.xcontent.XContentObjectMapper.parse(XContentObjectMapper.java:340)
at org.elasticsearch.index.mapper.xcontent.XContentObjectMapper.serializeObject(XContentObjectMapper.java:361)
at org.elasticsearch.index.mapper.xcontent.XContentObjectMapper.serializeArray(XContentObjectMapper.java:397)
at org.elasticsearch.index.mapper.xcontent.XContentObjectMapper.parse(XContentObjectMapper.java:334)
at org.elasticsearch.index.mapper.xcontent.XContentDocumentMapper.parse(XContentDocumentMapper.java:358)
at org.elasticsearch.index.mapper.xcontent.XContentDocumentMapper.parse(XContentDocumentMapper.java:308)
at org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:230)
at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:136)
at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:62)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:385)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.access$400(TransportShardReplicationOperationAction.java:212)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:282)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

[meghuizen]

Because the heap gets 1g, I'm not uploading the dump, which is currently full with attachments.

[clintongormley]

No further reports of this issue - assuming fixed

[ghost]

Same issue... With thousends of documents (PDF's). What can i do? /usr/bin/java -Xms256m -Xmx1g

[dadoonet]

@redmouthch Increase your memory settings.