New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DSL waits for the tsdb time boundaries to lapse #100470
Conversation
TSDB indices are expected to receive a large amounts of writes whilst their time bounds are "active" (i.e they include `now`). This ensures TSDB doesn't execute any ingest disruptive operations (like delete, forcemerge, downsample) until the `end_time` for the TSDS backing indices has lapsed.
Pinging @elastic/es-data-management (Team:Data Management) |
Hi @andreidan, I've created a changelog YAML for you. |
@elasticmachine update branch |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As we discussed offline, the code changes look great to me. We don't actually have any integration test coverage though (the changes to integration tests are just to get them compiling). It would be fairly hard to integration test this. I assume we could do something that would artificially get some TSDB indices in the state we want, and then do a test something like DataStreamLifecycleServiceIT.testAutomaticForceMerge(), but I don't know how to do that, or if it is even possible.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
💚 Backport successful
|
TSDB indices are expected to receive a large amounts of writes whilst their time bounds are "active" (i.e they include `now`). This ensures TSDB doesn't execute any ingest disruptive operations (like delete, forcemerge, downsample) until the `end_time` for the TSDS backing indices has lapsed.
TSDB indices are expected to receive a large amounts of writes whilst their time bounds are "active" (i.e they include `now`). This ensures TSDB doesn't execute any ingest disruptive operations (like delete, forcemerge, downsample) until the `end_time` for the TSDS backing indices has lapsed.
TSDB indices are expected to receive a large amount of writes whilst their time bounds are "active" (i.e. they include
now
). This ensures TSDB doesn't execute any ingest disruptive operations (like delete, forcemerge, downsample) until theend_time
for the TSDS backing indices has lapsed.Fixes #99696