Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Lower the translog flush triggers to workaround #6363 #6377

Closed
mikemccand opened this issue Jun 2, 2014 · 0 comments
Closed

Lower the translog flush triggers to workaround #6363 #6377

mikemccand opened this issue Jun 2, 2014 · 0 comments
Assignees
@s1monw
Labels
>bug :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. v1.2.1 v1.3.0 v2.0.0-beta1

Comments

@mikemccand
Copy link
Contributor

If we don't do #6363 for 1.2.1 then we should consider lowering the translog flush triggers (which we increased in 1.2 to prevent too-frequent commits), because the versionMap is only cleared on flush not on refresh. It can easily tie up a lot of RAM, put GC pressure, etc.; when Full GC does run it takes a looong time w/ that map.
@s1monw s1monw added v1.2.2 and removed v1.2.1 labels Jun 3, 2014
@s1monw s1monw self-assigned this Jun 3, 2014
s1monw added a commit that referenced this issue Jun 3, 2014
@s1monw
Translog: Revert unlimited flush_treshold_ops for translog
648d012 
This commit reverts the commit for issue #5900 introduced
in `1.2.0`. The unlimited translog size can cause memory pressure
on ES instances with low memory and high indexing load.

Closes #6377
@s1monw s1monw closed this as completed in 4b28bc3 Jun 3, 2014
s1monw added a commit that referenced this issue Jun 3, 2014
@s1monw
Translog: Revert unlimited flush_treshold_ops for translog
2d32c58 
This commit reverts the commit for issue #5900 introduced
in `1.2.0`. The unlimited translog size can cause memory pressure
on ES instances with low memory and high indexing load.

Closes #6377
@clintongormley clintongormley changed the title Lower the translog flush triggers to workaround #6363 Indexing: Lower the translog flush triggers to workaround #6363 Jul 16, 2014
@clintongormley clintongormley changed the title Indexing: Lower the translog flush triggers to workaround #6363 Lower the translog flush triggers to workaround #6363 Jun 7, 2015
mute pushed a commit to mute/elasticsearch that referenced this issue Jul 29, 2015
@s1monw
Translog: Revert unlimited flush_treshold_ops for translog
1bcc270 
This commit reverts the commit for issue elastic#5900 introduced
in `1.2.0`. The unlimited translog size can cause memory pressure
on ES instances with low memory and high indexing load.

Closes elastic#6377
@clintongormley clintongormley added :Distributed/Distributed A catch all label for anything in the Distributed Area. If you aren't sure, use this one. :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. and removed :Translog :Distributed/Distributed A catch all label for anything in the Distributed Area. If you aren't sure, use this one. labels Feb 13, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@s1monw s1monw

Labels
>bug :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. v1.2.1 v1.3.0 v2.0.0-beta1
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@clintongormley @mikemccand @s1monw