Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Counting messages fails with high number of indices #4136

Closed
joschi opened this issue Sep 10, 2017 · 0 comments
Closed

Counting messages fails with high number of indices #4136

joschi opened this issue Sep 10, 2017 · 0 comments
Assignees
Milestone

Comments

@joschi
Copy link
Contributor

@joschi joschi commented Sep 10, 2017

Retrieving the indexer overview page (/system/indexer/overview/{index_set_id}) fails if there is a large number of indices in the Graylog cluster.

This occurrence seems to have been missed in #4054.

Refs https://community.graylog.org/t/cant-get-index-message-counts-after-2-2-6-2-3-1-upgrade/2391

@joschi joschi added this to the 2.3.2 milestone Sep 10, 2017
joschi pushed a commit that referenced this issue Sep 13, 2017
Jochen Schalanda
The Elasticsearch Count API doesn't allow setting the indices in the HTTP request body
and suffers from the issue that users with a large number of indices run into the default
HTTP header size limit of Elasticsearch (4 KB).

This change set replaces the (kind of) deprecated Counts API with a regular search with
size=0 issued via the Elasticsearch Multi Search API which allows specifiying the list
of indices in the request body.

Fixes #4136
Refs elastic/elasticsearch#13928
joschi pushed a commit that referenced this issue Sep 14, 2017
Jochen Schalanda
The Elasticsearch Count API doesn't allow setting the indices in the HTTP request body
and suffers from the issue that users with a large number of indices run into the default
HTTP header size limit of Elasticsearch (4 KB).

This change set replaces the (kind of) deprecated Counts API with a regular search with
size=0 issued via the Elasticsearch Multi Search API which allows specifiying the list
of indices in the request body.

Fixes #4136
Refs elastic/elasticsearch#13928
@ghost ghost assigned joschi Sep 14, 2017
@ghost ghost added the in progress label Sep 14, 2017
@bernd bernd closed this in #4147 Sep 19, 2017
@ghost ghost removed the in progress label Sep 19, 2017
bernd added a commit that referenced this issue Sep 19, 2017
* Replace "deprecated" Counts API with Multi Search with size=0

The Elasticsearch Count API doesn't allow setting the indices in the HTTP request body
and suffers from the issue that users with a large number of indices run into the default
HTTP header size limit of Elasticsearch (4 KB).

This change set replaces the (kind of) deprecated Counts API with a regular search with
size=0 issued via the Elasticsearch Multi Search API which allows specifiying the list
of indices in the request body.

Fixes #4136
Refs elastic/elasticsearch#13928

* Use MultiSearchResult.MultiSearchResponse instead of working on JSON object

* Fix JestUtilsTest
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
1 participant
You can’t perform that action at this time.