New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[put-mapping] can timeout #1502

Closed
pdepaepe opened this Issue Oct 22, 2015 · 2 comments

Comments

Projects
None yet
2 participants
@pdepaepe

pdepaepe commented Oct 22, 2015

Hello,

On a big ES cluster, while rotating indice, put-mapping operation can timeout and block following index range calculation.

2015-10-21T15:08:48.622Z ERROR [IndexRotationThread] Couldn't point deflector to a new index
org.elasticsearch.cluster.metadata.ProcessClusterEventTimeoutException: failed to process cluster event (put-mapping [index_range]) within 30s
    at org.elasticsearch.cluster.service.InternalClusterService$2$1.run(InternalClusterService.java:278)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
2015-10-21T15:08:52.310Z WARN  [IndexRotationThread] Deflector is pointing to [graylog2_993], not the newest one: [graylog2_994]. Re-pointing.
2015-10-21T15:09:33.380Z WARN  [EsIndexRangeService] Couldn't load index range for index graylog2_994
2015-10-21T15:09:33.381Z WARN  [EsIndexRangeService] Couldn't load index range for index graylog2_993

I know, index range is rollbacked to mongo, but instead of set field mapping dynamically, why not inject a "graylog2 template" on graylog startup and so avoid completely this operation?

https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-templates.html

@bernd

This comment has been minimized.

Member

bernd commented Nov 20, 2015

In #1563 we changed the index creation operation to include the mapping instead of having it in two separate operations.

Creating index templates on Graylog boot is something that we might consider doing later. Marking this as feature.

Thank you for the report!

@bernd

This comment has been minimized.

Member

bernd commented Sep 23, 2016

Graylog is creating a Elasticsearch index template during boot since 2.0.

@bernd bernd closed this Sep 23, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment