Skip to content
Merged
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added manage-data/images/ilm-fleet-data-streams.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added manage-data/images/ilm-integration-assets.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion manage-data/lifecycle/index-lifecycle-management.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ For example, if you are indexing metrics data from a fleet of ATMs into Elastics
You can create and manage index lifecycle policies through {{kib}}'s [Index Management](/manage-data/data-store/index-basics.md#index-management) UI or the [{{ilm-init}} APIs](https://www.elastic.co/docs/api/doc/elasticsearch/v8/group/endpoint-ilm). For more details on creating and managing index lifecycle policies refer to:

* [Configure a lifecycle policy](/manage-data/lifecycle/index-lifecycle-management/configure-lifecycle-policy.md)
* [View the lifecycle status of an index](/manage-data/lifecycle/index-lifecycle-management/policy-view-status.md)
* [View the lifecycle status of an index or datastream](/manage-data/lifecycle/index-lifecycle-management/policy-view-status.md)
* [Update or switch a lifecycle policy](/manage-data/lifecycle/index-lifecycle-management/policy-updates.md)
* [Start and stop index lifecycle management](/manage-data/lifecycle/index-lifecycle-management/start-stop-index-lifecycle-management.md)
* [Restore a managed data stream or index](/manage-data/lifecycle/index-lifecycle-management/restore-managed-data-stream-index.md)
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
---
navigation_title: Manage the lifecycle policy for integrations data
applies_to:
stack: ga
products:
- id: elasticsearch
---

# Manage the lifecycle policy for integrations data [ilm-manage-lifecycle-policy-integrations-data]

An Elastic integration is a pre-packaged collection of assets that provides an effective, simplified way to monitor a product, system, or service, with minimal required setup. Most integrations rely on {{agent}} as an ingest mechanism, and the policies used to govern installed integrations are managed in {{fleet}}.

You can find installation and configuration details for all integrations in the [Elastic integrations](https://docs.elastic.co/en/integrations) chapter of the **Reference** section. To learn about managing your installed integrations, refer to [Manage Elastic Agent integrations](/reference/fleet/manage-integrations.md) in the {{fleet}} and {{agent}} chapter of the **Reference** section.

When you install an integration, an [{{ilm}}](/manage-data/lifecycle/index-lifecycle-management.md) ({{ilm-init}}) policy is configured automatically to manage the integration's component [data streams](/manage-data/data-store/data-streams.md) and their backing indices. To view or adjust how your integration data is managed, a first step is to find the data streams that you're interested in. There are a few ways to do this:

::::{dropdown} Find the data stream for a {{kib}} visualation
To find the data stream associated with a visualization in a {{kib}}:

1. Open **Dashboards** from the {{kib}} menu and select a dashboard to view. For example, with the [System integration](integration-docs://reference/system.md) installed, you can open the `[Metrics System] Host overview` dashboard to find visualizations about the host system being monitored.

1. Hover over any visualization and click the **Explore in Discover** icon.

![Explore in discover](/manage-data/images/ilm-explore-in-discover.png "")

1. In **Discover**, the list of documents shows the columns for fields applicable to the visualzation that you selected. Select any document that has data for those fields and click the **Toggle dialog with details** icon.

![Discover documents list](/manage-data/images/ilm-toggle-document-details.png "")

1. In the document details, note that there are three `data_stream` fields. The full [data stream name](/reference/fleet/data-streams.md#data-streams-naming-scheme) is a composite of `data_stream.type`, `data_stream.dataset` and `data_stream.namespace`, separated by a hyphen. For example, in the System integration, the **CPU usage over time** visualization is associated with the `metrics-system.cpu-default` data stream.

You can also see the data stream's current backing index, as well as other information such as the document timestamp and details about the agent that ingested the data.

![Document details](/manage-data/images/ilm-document-data-stream.png "")
::::

::::{dropdown} Find the data streams for an integration
To find the data streams associated with an installed integration:

1. In {{kib}} go to **Management > Integrations > Installed integrations** and select any integration.

1. Open the **Assets** tab and expand the **Index templates** list.

In the list, the name of each [index template](/manage-data/data-store/templates.md) matches an associated data stream. For example, the `metrics-system.cpu` template matches the `metrics-system.cpu-default` data stream that is set up when the System integration is installed.

![Integration assets](/manage-data/images/ilm-integration-assets.png "")
::::

::::{dropdown} Find the data streams managed in {{fleet}}
To find all of the data streams that are managed in {{fleet}}:

1. In {{kib}} go to **Management > {{fleet}}** and select the **Data streams** tab.

1. Use the search field and dropdown menus to filter the list. You can filter by the data stream type, dataset, namespace, or by the integration that the data stream belongs to.

![Integration assets](/manage-data/images/ilm-fleet-data-streams.png "")
::::

For any data stream that you're interested in, you can [view its current lifecycle status](/manage-data/lifecycle/index-lifecycle-management/policy-view-status.md), including details about its associated ILM policy.

After you've identified one or more data streams for which you'd like to customize how the data is managed over time, refer to our tutorials:

* For a general guide about configuring a custom ILM policy for any managed data stream, try out our [Customize built-in policies](/manage-data/lifecycle/index-lifecycle-management/tutorial-customize-built-in-policies.md) tutorial in the data lifecycle documentation.
* For the steps to customize an ILM policy for a set of data streams, such as all logs or metrics data streams across all namespaces, across only a selected namespace, and others, check the set of tutorials in [Customize data retention policies](/reference/fleet/data-streams-ilm-tutorial.md) in the {{fleet}} and {{agent}} reference documentation.
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
navigation_title: View the lifecycle status of an index
navigation_title: View the lifecycle status of an index or data stream
mapped_pages:
- https://www.elastic.co/guide/en/elasticsearch/reference/current/update-lifecycle-policy.html
applies_to:
Expand All @@ -8,9 +8,9 @@ products:
- id: elasticsearch
---

# View the lifecycle status of an index [view-lifecycle-status]
# View the lifecycle status of an index or data stream [view-lifecycle-status]

For any existing managed index in your cluster, you can access the ILM policy applied to it and details such as its current phase.
For any existing managed index or data stream in your cluster, you can access the ILM policy applied to it and its current status.

:::::{tab-set}
:group: kibana-api
Expand Down
1 change: 1 addition & 0 deletions manage-data/toc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,7 @@ toc:
- file: lifecycle/index-lifecycle-management/configure-lifecycle-policy.md
- file: lifecycle/index-lifecycle-management/policy-apply.md
- file: lifecycle/index-lifecycle-management/policy-view-status.md
- file: lifecycle/index-lifecycle-management/manage-lifecycle-integrations-data.md
- file: lifecycle/index-lifecycle-management/policy-updates.md
- file: lifecycle/index-lifecycle-management/start-stop-index-lifecycle-management.md
- file: lifecycle/index-lifecycle-management/restore-managed-data-stream-index.md
Expand Down
Loading