Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure that the number of index_shards for the Graylog charm is at least equal to the number of Elasticsearch nodes #206

Open
zxhdaze opened this issue Apr 26, 2024 · 0 comments

Comments

@zxhdaze
Copy link
Contributor

zxhdaze commented Apr 26, 2024

The default number of Elasticsearch shards per index for the Graylog charm is 2 [0]. This means that when more than two ES nodes are deployed one or more get no shards assigned and are essentially unused for the lifetime of each index. When the index is rotated a different set of nodes are typically chosen but this means that some the compute capacity is unused each time, and disk usage can be uneven (because the quantity of logs can vary over time, when different nodes are in use)

Another option would be to use the setting of '0' to handle this automatically, but not sure how well this works for expansions of existing clusters, etc.

index_shards:
default: 2
description: |
Number of Elasticsearch shards used per index in this index set. Set this to '0' to let the charm automatically calculate based on how many Elasticsearch units.
source: default
type: int
value: 2

[0] https://jaas.ai/graylog

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant