From 3abab3d907e22189754d341a047c8acad0ec62ad Mon Sep 17 00:00:00 2001 From: David Kilfoyle Date: Wed, 17 Sep 2025 15:37:31 -0400 Subject: [PATCH 1/3] Updates to 'Migrate to ILM on self/ECK' --- .../manage-existing-indices.md | 9 +++++---- .../lifecycle/index-lifecycle-management/policy-apply.md | 2 +- 2 files changed, 6 insertions(+), 5 deletions(-) diff --git a/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md b/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md index 139176dbca..54be91772c 100644 --- a/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md +++ b/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md @@ -12,22 +12,23 @@ products: # Migrate to {{ilm-init}} on self-managed and {{eck}} deployments [ilm-with-existing-indices] -If you’ve been using Curator or some other mechanism to manage periodic indices, you have a couple of options when [migrating to {{ilm-init}}](./migrate-index-management.md): +If you’ve been using [](/manage-data/lifecycle/curator.md) or some other mechanism to manage periodic indices, you have a couple of options when [migrating to {{ilm-init}}](./migrate-index-management.md): * Set up your index templates to use an {{ilm-init}} policy to manage your new indices. Once {{ilm-init}} is managing your current write index, you can apply an appropriate policy to your old indices. * Reindex into an {{ilm-init}}-managed index. ::::{note} -Starting in Curator version 5.7, Curator ignores {{ilm-init}}-managed indices. +* Starting in Curator version 5.7, Curator ignores {{ilm-init}}-managed indices. +* This document is specifically about setting up {{ilm-init}} for managed indices. To manage the lifecycle of a [data stream](/manage-data/data-store/data-streams.md) you can opt to use either {{ilm-init}} or data stream lifecycle. Refer to [](/manage-data/lifecycle.md) for a comparison. :::: ## Apply policies to existing time series indices [ilm-existing-indices-apply] -The simplest way to transition to managing your periodic indices with {{ilm-init}} is to [configure an index template](configure-lifecycle-policy.md#apply-policy-template) to apply a lifecycle policy to new indices. Once the index you are writing to is being managed by {{ilm-init}}, you can [manually apply a policy](/manage-data/lifecycle/index-lifecycle-management/policy-updates.md) to your older indices. +The simplest way to transition to managing your periodic indices with {{ilm-init}} is to [configure an index template](configure-lifecycle-policy.md#apply-policy-template) to apply a lifecycle policy to new indices. You can check these [example {{ilm-init}} polices](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-rollover.md#ilm-rollover-ex) that initiate index rollover based on different criteria. -Define a separate policy for your older indices that omits the rollover action. Rollover is used to manage where new data goes, so isn’t applicable. +Once the index you are writing to is being managed by {{ilm-init}}, you can [manually apply a policy](/manage-data/lifecycle/index-lifecycle-management/policy-apply.md) to your older indices. Define a separate policy for your older indices that omits the rollover action. Rollover is used to manage where new data goes, so isn’t applicable. Keep in mind that policies applied to existing indices compare the `min_age` for each phase to the original creation date of the index, and might proceed through multiple phases immediately. If your policy performs resource-intensive operations like force merge, you don’t want to have a lot of indices performing those operations all at once when you switch over to {{ilm-init}}. diff --git a/manage-data/lifecycle/index-lifecycle-management/policy-apply.md b/manage-data/lifecycle/index-lifecycle-management/policy-apply.md index b3e56d355a..d08089caa6 100644 --- a/manage-data/lifecycle/index-lifecycle-management/policy-apply.md +++ b/manage-data/lifecycle/index-lifecycle-management/policy-apply.md @@ -19,7 +19,7 @@ You can also apply a lifecycle policy manually to existing indices that are not Consider the following before manually applying a policy to an index: * If an index is currently managed by an ILM policy you must first remove that policy before applying a new one. To remove or make changes to an {{ilm-init}} policy currently applied to one or more indices, or to switch indices to use a different policy, refer to [Update or switch a lifecycle policy](/manage-data/lifecycle/index-lifecycle-management/policy-updates.md). -* Do not manually apply a policy that uses the rollover action. Policies that use rollover must be applied by the [index template](/manage-data/lifecycle/index-lifecycle-management/configure-lifecycle-policy.md#apply-policy-template). Otherwise, the policy is not carried forward when the rollover action creates a new index. +* Do not manually apply a policy that uses the rollover action. Policies that use rollover must be applied by the [index template](/manage-data/lifecycle/index-lifecycle-management/configure-lifecycle-policy.md#apply-policy-template). Otherwise, the policy is not carried forward when the rollover action creates a new index. For an approach to migrating existing indices that supports rollover, refer to [](/manage-data/lifecycle/index-lifecycle-management/migrate-ilm.md). ::: You can do this procedure in {{kib}} or using the {{es}} API. From eb54401afa3476f43424a951e7a0e30f45297db3 Mon Sep 17 00:00:00 2001 From: David Kilfoyle Date: Wed, 17 Sep 2025 16:29:29 -0400 Subject: [PATCH 2/3] fixup --- .../index-lifecycle-management/manage-existing-indices.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md b/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md index 54be91772c..c254525f4e 100644 --- a/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md +++ b/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md @@ -26,7 +26,7 @@ If you’ve been using [](/manage-data/lifecycle/curator.md) or some other mecha ## Apply policies to existing time series indices [ilm-existing-indices-apply] -The simplest way to transition to managing your periodic indices with {{ilm-init}} is to [configure an index template](configure-lifecycle-policy.md#apply-policy-template) to apply a lifecycle policy to new indices. You can check these [example {{ilm-init}} polices](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-rollover.md#ilm-rollover-ex) that initiate index rollover based on different criteria. +The simplest way to transition to managing your periodic indices with {{ilm-init}} is to [configure an index template](configure-lifecycle-policy.md#apply-policy-template) to apply a lifecycle policy to new indices. A number of [example {{ilm-init}} polices](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-rollover.md#ilm-rollover-ex) are available, showing how the policy can index rollover based on different criteria. Once the index you are writing to is being managed by {{ilm-init}}, you can [manually apply a policy](/manage-data/lifecycle/index-lifecycle-management/policy-apply.md) to your older indices. Define a separate policy for your older indices that omits the rollover action. Rollover is used to manage where new data goes, so isn’t applicable. From 95dd69ec0333b23c3f592581c8d9b3dfba5112fb Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 17 Sep 2025 17:50:10 -0400 Subject: [PATCH 3/3] Update manage-existing-indices.md --- .../index-lifecycle-management/manage-existing-indices.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md b/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md index c254525f4e..643b1c8ab3 100644 --- a/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md +++ b/manage-data/lifecycle/index-lifecycle-management/manage-existing-indices.md @@ -26,7 +26,7 @@ If you’ve been using [](/manage-data/lifecycle/curator.md) or some other mecha ## Apply policies to existing time series indices [ilm-existing-indices-apply] -The simplest way to transition to managing your periodic indices with {{ilm-init}} is to [configure an index template](configure-lifecycle-policy.md#apply-policy-template) to apply a lifecycle policy to new indices. A number of [example {{ilm-init}} polices](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-rollover.md#ilm-rollover-ex) are available, showing how the policy can index rollover based on different criteria. +The simplest way to transition to managing your periodic indices with {{ilm-init}} is to [configure an index template](configure-lifecycle-policy.md#apply-policy-template) to apply a lifecycle policy to new indices. A number of [example {{ilm-init}} polices](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-rollover.md#ilm-rollover-ex) are available, showing how index rollover can be initiated based on different criteria. Once the index you are writing to is being managed by {{ilm-init}}, you can [manually apply a policy](/manage-data/lifecycle/index-lifecycle-management/policy-apply.md) to your older indices. Define a separate policy for your older indices that omits the rollover action. Rollover is used to manage where new data goes, so isn’t applicable. @@ -107,4 +107,4 @@ To reindex into the managed index: Querying using this alias will now search your new data and all of the reindexed data. -6. Once you have verified that all of the reindexed data is available in the new managed indices, you can safely remove the old indices. \ No newline at end of file +6. Once you have verified that all of the reindexed data is available in the new managed indices, you can safely remove the old indices.