Skip to content
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,17 @@ applies_to:
---
# Manual pipeline configuration [streams-manual-pipeline-configuration]

:::{note}
The manual pipeline configuration processor is only available on [classic streams](../../streams.md#streams-classic-vs-wired).
:::

Copy link
Contributor

@nastasha-solomon nastasha-solomon Nov 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Commenting here since I can't comment below. This reference isn't rendering correctly in the preview. I haven't verified the path yet but did notice that you used square brackets around elasticsearch://reference/enrich-processor.md instead of parentheses (()). Changing the brackets to parentheses might do the trick.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated! let's see what happens now!

The **Manual pipeline configuration** lets you create a JSON-encoded array of ingest pipeline processors.This is helpful if you want to add more advanced processing that isn't currently available as part of the UI-based processors.

Refer to the following documentation for more on manually configuring processors:

- [Create readable and maintainable ingest pipelines](../../../../../manage-data/ingest/transform-enrich/readable-maintainable-ingest-pipelines.md)
- [Error handling in ingest pipelines](../../../../../manage-data/ingest/transform-enrich/error-handling.md)
- [Ingest processor reference][elasticsearch://reference/enrich-processor.md]
- [Ingest processor reference](elasticsearch://reference/enrich-processor/index.md)

To manually create an array of ingest pipeline processors:

Expand Down
24 changes: 12 additions & 12 deletions solutions/observability/streams/streams.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,11 +8,11 @@ applies_to:

Streams provides a single, centralized UI within {{kib}} that streamlines common tasks like extracting fields, setting data retention, and routing data, so you don't need to use multiple applications or manually configure underlying {{es}} components.

## Classic vs. wired streams
## Classic versus wired streams [streams-classic-vs-wired]

Streams can operate in two modes: wired and classic. Both manage data streams in {{es}}, but differ in configuration, inheritance, and field mapping.

### Classic streams
### Classic streams [streams-classic-streams]

Classic streams work with existing {{es}} data streams. Use classic streams when you want the ease of extracting fields and configuring data retention while working with data that's already being ingested into {{es}}.

Expand All @@ -22,13 +22,13 @@ Classic streams:
- Can follow the data retention policy set in the existing index template.
- Do not support hierarchical inheritance or cascading configuration updates.

### Wired streams
### Wired streams [streams-wired-streams]
```{applies_to}
stack: preview 9.2
serverless: preview
```

Wired streams data is sent directly to a single endpoint, from which you can route data into child streams based on [partitioning](./management/partitioning.md) set up manually or with the help of AI suggestions.
Wired streams send data directly to a single endpoint, from which you can route data into child streams based on [partitioning](./management/partitioning.md) set up manually or with the help of AI suggestions.

Wired streams:
- Allow you to organize streams in a parent-child hierarchy.
Expand All @@ -37,22 +37,22 @@ Wired streams:

For more information, refer to [sending data to wired streams](./wired-streams.md).

## Managed components
## Managed components [streams-managed-components]
When you configure classic or wired streams through the Streams UI or [Streams API](#streams-api), {{es}}-level components like templates and pipelines are created for the stream. These components are considered *managed* and shouldn't be modified using {{es}} APIs. When managing a stream through the Streams UI or API, continue doing so whenever possible.

You can still edit non-managed ingest pipelines, templates, and other components, but avoid those marked as managed or any per-data-stream mappings and settings. This behavior is similar to how Elasticsearch handles components managed by integrations. Refer to the [**Advanced** tab](./management/advanced.md) to review managed components.

## Required permissions
## Required permissions [streams-required-permissions]

Streams requires the following permissions:

::::{tab-set}

:::{tab-item} Serverless
Streams requires these Elastic Cloud Serverless roles:
:::{tab-item} {{serverless-short}}
Streams requires these {{serverless-full}} roles:

- Admin: Ability to manage all Streams
- Editor/Viewer: Limited access, unable to perform all actions
- Editor/Viewer: Limited access, cannot perform all actions

:::

Expand All @@ -71,15 +71,15 @@ For more information, refer to [Cluster privileges](elasticsearch://reference/el

::::

## Access Streams
## Access Streams [streams-access]

Open Streams from the following places in {{kib}}:

- Select **Streams** from the navigation menu or use the [global search field](../../../explore-analyze/find-and-organize/find-apps-and-objects.md).

- Open the data stream for a specific document from **Discover**. To do this, expand the details flyout for a document that's stored in a data stream, and select **Stream** or an action associated with the document's data stream. Streams will open filtered to the selected data stream.
- Open the data stream for a specific document from **Discover**. To do this, expand the details flyout for a document that's stored in a data stream, and select **Stream** or an action associated with the document's data stream. Streams then opens filtered to the selected data stream.

### Streams API
### Streams API [streams-api]
``` yaml {applies_to}
stack: preview 9.1
serverless: preview
Expand Down
Loading