Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[put-mapping] can timeout #1502

Closed
pdepaepe opened this issue Oct 22, 2015 · 2 comments
Closed

[put-mapping] can timeout #1502

pdepaepe opened this issue Oct 22, 2015 · 2 comments
Assignees
Labels
Milestone

Comments

@pdepaepe
Copy link
Contributor

@pdepaepe pdepaepe commented Oct 22, 2015

Hello,

On a big ES cluster, while rotating indice, put-mapping operation can timeout and block following index range calculation.

2015-10-21T15:08:48.622Z ERROR [IndexRotationThread] Couldn't point deflector to a new index
org.elasticsearch.cluster.metadata.ProcessClusterEventTimeoutException: failed to process cluster event (put-mapping [index_range]) within 30s
    at org.elasticsearch.cluster.service.InternalClusterService$2$1.run(InternalClusterService.java:278)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
2015-10-21T15:08:52.310Z WARN  [IndexRotationThread] Deflector is pointing to [graylog2_993], not the newest one: [graylog2_994]. Re-pointing.
2015-10-21T15:09:33.380Z WARN  [EsIndexRangeService] Couldn't load index range for index graylog2_994
2015-10-21T15:09:33.381Z WARN  [EsIndexRangeService] Couldn't load index range for index graylog2_993

I know, index range is rollbacked to mongo, but instead of set field mapping dynamically, why not inject a "graylog2 template" on graylog startup and so avoid completely this operation?

https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-templates.html

@bernd
Copy link
Member

@bernd bernd commented Nov 20, 2015

In #1563 we changed the index creation operation to include the mapping instead of having it in two separate operations.

Creating index templates on Graylog boot is something that we might consider doing later. Marking this as feature.

Thank you for the report!

@bernd
Copy link
Member

@bernd bernd commented Sep 23, 2016

Graylog is creating a Elasticsearch index template during boot since 2.0.

@bernd bernd closed this Sep 23, 2016
@ghost ghost assigned bernd Sep 23, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants