Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop writes before the retention policy time window #6708

Closed
jwilder opened this issue May 23, 2016 · 0 comments
Closed

Drop writes before the retention policy time window #6708

jwilder opened this issue May 23, 2016 · 0 comments
Assignees
Milestone

Comments

@jwilder
Copy link
Contributor

jwilder commented May 23, 2016

#6635 seems to be caused by writes into the past that triggers new shard groups and shards to get created. These shards would end up getting removed when retention policy enforcement runs, but they can create a lot of overhead and memory pressure before retention policy enforcement runs. If the shard duration is somewhat small (1d or less), many shards can get created in this time.

We should drop writes if they would end up creating shard groups that are already expired as defined by the retention policy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants