Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce the index.lifecycle.prefer_ilm setting #95423

Merged
merged 8 commits into from
Apr 25, 2023

Conversation

andreidan
Copy link
Contributor

@andreidan andreidan commented Apr 20, 2023

This introduces an index setting that'll allow to switch the preference for the system that manages a data stream backing index. This setting defaults to true (preferring ILM when both ILM and DLM are applicable for an index).

Note that the prefer_ilm setting will only express a preference, it'll not enforce the presence of a particular management service e.g. if an index has prefer_ilm: false and an ILM policy configured, but no DLM configuration, the index will be managed by ILM (despite the preference for DLM)

Note that documentation for the setting will be done in a subsequent PR.
There will also be subsequent work to improve the GET _data_stream API to better indicate which system manages each backing index.

Relates to #93596

This introduces an index setting that'll allow to switch the preference
for the system that manages a data stream backing index. This setting
defaults to `true` (preferring ILM when both ILM and DLM are applicable
for an index).

Note that the prefer_ilm setting will only express a preference, it'll not
enforce the presence of a particular management service e.g. if an index has
`prefer_ilm: false` and an ILM policy configured, but no DLM configuration,
the index will be managed by ILM (despite the preference for DLM)
@elasticsearchmachine
Copy link
Collaborator

Hi @andreidan, I've created a changelog YAML for you.

@andreidan andreidan marked this pull request as ready for review April 20, 2023 16:23
@andreidan andreidan requested a review from dakrone April 20, 2023 16:23
@elasticsearchmachine elasticsearchmachine added the Team:Data Management Meta label for data/management team label Apr 20, 2023
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

@andreidan andreidan requested a review from gmarouli April 20, 2023 16:31
Copy link
Member

@dakrone dakrone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for all the tests for this Andrei, they're great.

@andreidan
Copy link
Contributor Author

@elasticmachine update branch

Copy link
Contributor

@gmarouli gmarouli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for adding this flag @andreidan . LGTM, I have one minor comment, (apologies if they are there and I missed them) I was thinking it would be nice to a couple of tests also from DLM to ILM, if it's a path we support it should be tests. It can also come from a subsequent PR.

Co-authored-by: Mary Gouseti <mgouseti@gmail.com>
@andreidan
Copy link
Contributor Author

@gmarouli Thanks for the review

was thinking it would be nice to a couple of tests also from DLM to ILM

That's a great shout, I'll add them in a follow up PR if that's ok (this PR is quite big already)

@andreidan
Copy link
Contributor Author

@elasticmachine update branch

@andreidan
Copy link
Contributor Author

Opened #95524

@elasticmachine run elasticsearch-ci/part-2

@andreidan andreidan merged commit 545a51d into elastic:main Apr 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>feature Team:Data Management Meta label for data/management team v8.8.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants