Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Config: Use Merge Throttling by default in 0.90.1 #3033

Closed
s1monw opened this Issue May 14, 2013 · 2 comments

Comments

Projects
None yet
2 participants
@s1monw
Copy link
Contributor

commented May 14, 2013

Merge Throttling is one of the most recommended settings and crucial in the RealTime indexing case. We should set the default to a reasonable setting that allows folks to index in a production index and don't see large merge peaks by default. Yet, the default here is hard to calculate and solely relies on experience from production environments. The right settings depends on the actual hardware used and can't be easily predicted.

if somebody has experience with a good setting, sharing HW setup and throttle setting would be much appreciated.

@ghost ghost assigned s1monw May 14, 2013

@clintongormley

This comment has been minimized.

Copy link
Member

commented May 14, 2013

I have been thinking about a startup script that checks if the cluster name is the default one, then offers to generate a config based on the local hardware, so eg it could:

  • ask you to choose a cluster name
  • recommend a heap size
  • advise about swap
  • do a disk test and advise about merge settings
  • ???
@s1monw

This comment has been minimized.

Copy link
Contributor Author

commented May 14, 2013

@clintongormley can you create a different issue for this? I think this is unrelated - even with the HW spec we can't really make a better / worse choice

@s1monw s1monw closed this in 6624949 May 14, 2013

s1monw added a commit that referenced this issue May 14, 2013

Use Merge Throtteling by default on node level.
Merge Throtteling is one of the most recommended settings and crucial in the
RealTime indexing case. We should set the default to a reasonable setting
that allows folks to index in a production index and don't see large merge
peaks by default. The default is set to 20 MB/sec on the node level.

Closes #3033

mute pushed a commit to mute/elasticsearch that referenced this issue Jul 29, 2015

Use Merge Throtteling by default on node level.
Merge Throtteling is one of the most recommended settings and crucial in the
RealTime indexing case. We should set the default to a reasonable setting
that allows folks to index in a production index and don't see large merge
peaks by default. The default is set to 20 MB/sec on the node level.

Closes elastic#3033
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.