Skip to content

[DOCS-10886] Add OP Custom Processor #29565

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Jun 4, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 20 additions & 15 deletions config/_default/menus/main.en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5649,81 +5649,86 @@ menu:
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_add_hostname
weight: 902
- name: Custom Processor
url: observability_pipelines/processors/custom_processor
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_custom_processor
weight: 903
- name: Deduplicate
url: observability_pipelines/processors/dedupe
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_dedupe
weight: 903
weight: 904
- name: Edit fields
url: observability_pipelines/processors/edit_fields
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_edit_fields
weight: 904
weight: 905
- name: Enrichment Table
url: observability_pipelines/processors/enrichment_table
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_enrichment_table
weight: 905
weight: 906
- name: Filter
url: observability_pipelines/processors/filter
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_filter
weight: 906
weight: 907
- name: Generate Metrics
url: observability_pipelines/processors/generate_metrics
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_generate_metrics
weight: 907
weight: 908
- name: Grok Parser
url: observability_pipelines/processors/grok_parser
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_grok_parser
weight: 908
weight: 909
- name: Parse JSON
url: observability_pipelines/processors/parse_json
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_parse_json
weight: 909
weight: 910
- name: Parse XML
url: observability_pipelines/processors/parse_xml
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_parse_xml
weight: 910
weight: 911
- name: Quota
url: observability_pipelines/processors/quota
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_quota
weight: 911
weight: 912
- name: Reduce
url: observability_pipelines/processors/reduce
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_reduce
weight: 912
weight: 913
- name: Remap to OCSF
url: observability_pipelines/processors/remap_ocsf
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_remap_ocsf
weight: 913
weight: 914
- name: Sample
url: observability_pipelines/processors/sample
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_sample
weight: 914
weight: 915
- name: Sensitive Data Scanner
url: observability_pipelines/processors/sensitive_data_scanner
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_sensitive_data_scanner
weight: 915
weight: 916
- name: Split Array
url: observability_pipelines/processors/split_array
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_split_array
weight: 916
weight: 917
- name: Throttle
url: observability_pipelines/processors/throttle
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_throttle
weight: 917
weight: 918
- name: Destinations
url: observability_pipelines/destinations/
parent: observability_pipelines
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
---
title: Custom Processor
disable_toc: false
---

{{< callout src="#" header="false" btn_hidden="true" >}}
The Custom Processor is in Preview.
{{< /callout >}}

{{% observability_pipelines/processors/custom_processor %}}

## Custom functions

{{< whatsnext desc="The functions are organized into the following categories:" >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#array" >}}Array{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#codec" >}}Codec{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#convert" >}}Convert{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#cryptography" >}}Cryptography{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#debug" >}}Debug{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#enrichment" >}}Enrichment{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#ip" >}}IP{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#number" >}}Number{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#object" >}}Object{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#parse" >}}Parse{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#path" >}}Path{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#random" >}}Random{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#string" >}}String{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#system" >}}System{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#timestamp" >}}Timestamp{{< /nextlink >}}
{{< nextlink href="observability_pipelines/processors/custom_processor/#type" >}}Type{{< /nextlink >}}
{{< /whatsnext >}}

{{< vrl-functions >}}
Original file line number Diff line number Diff line change
Expand Up @@ -201,6 +201,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -200,6 +200,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -203,6 +203,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -205,6 +205,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -202,6 +202,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -203,6 +203,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -200,6 +200,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -201,6 +201,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -201,6 +201,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -203,6 +203,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -203,6 +203,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -203,6 +203,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -204,6 +204,11 @@ Follow the instructions for the cloud provider you are using to archive your log

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -154,6 +154,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -152,6 +152,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -152,6 +152,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -154,6 +154,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -152,6 +152,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,11 @@ To set up the destination, follow the instructions for the cloud provider you ar

{{% observability_pipelines/processors/add_hostname %}}

{{% /tab %}}
{{% tab "Custom Processor" %}}

{{% observability_pipelines/processors/custom_processor %}}

{{% /tab %}}
{{% tab "Dedupe" %}}

Expand Down
Loading
Loading