Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add elasticsearch/ingest_pipeline metricset (#34012)
- Loading branch information
1 parent
f6fc904
commit 691d09f
Showing
19 changed files
with
785 additions
and
3 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
29 changes: 29 additions & 0 deletions
29
metricbeat/docs/modules/elasticsearch/ingest_pipeline.asciidoc
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,29 @@ | ||
//// | ||
This file is generated! See scripts/mage/docs_collector.go | ||
//// | ||
:edit_url: https://github.com/elastic/beats/edit/main/metricbeat/module/elasticsearch/ingest_pipeline/_meta/docs.asciidoc | ||
|
||
|
||
[[metricbeat-metricset-elasticsearch-ingest_pipeline]] | ||
=== Elasticsearch ingest_pipeline metricset | ||
|
||
beta[] | ||
|
||
include::../../../module/elasticsearch/ingest_pipeline/_meta/docs.asciidoc[] | ||
|
||
This is a default metricset. If the host module is unconfigured, this metricset is enabled by default. | ||
|
||
:edit_url: | ||
|
||
==== Fields | ||
|
||
For a description of each field in the metricset, see the | ||
<<exported-fields-elasticsearch,exported fields>> section. | ||
|
||
Here is an example document generated by this metricset: | ||
|
||
[source,json] | ||
---- | ||
include::../../../module/elasticsearch/ingest_pipeline/_meta/data.json[] | ||
---- | ||
:edit_url!: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Large diffs are not rendered by default.
Oops, something went wrong.
58 changes: 58 additions & 0 deletions
58
metricbeat/module/elasticsearch/ingest_pipeline/_meta/data.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,58 @@ | ||
{ | ||
"@timestamp": "2023-01-19T19:08:28.770Z", | ||
"elasticsearch": { | ||
"cluster": { | ||
"id": "WocBBA0QRma0sGpdQ7vLfQ", | ||
"name": "my-cluster" | ||
}, | ||
"node": { | ||
"name": "27fb1c2fd783", | ||
"roles": [ | ||
"ingest", | ||
"remote_cluster_client" | ||
], | ||
"id": "f5i3v9hMT_q__q6B9WOo5A" | ||
}, | ||
"ingest_pipeline": { | ||
"name": "my-pipeline", | ||
"total": { | ||
"count": 64, | ||
"failed": 0, | ||
"time": { | ||
"total": { | ||
"ms": 39 | ||
}, | ||
"self": { | ||
"ms": 39 | ||
} | ||
} | ||
} | ||
} | ||
}, | ||
"ecs": { | ||
"version": "8.0.0" | ||
}, | ||
"host": { | ||
"name": "myhost.local" | ||
}, | ||
"agent": { | ||
"type": "metricbeat", | ||
"version": "8.7.0", | ||
"ephemeral_id": "80fe51b6-57df-46d1-9240-20424df6d675", | ||
"id": "faab8154-7ceb-470f-b2ca-0aee636951c3", | ||
"name": "myhost.local" | ||
}, | ||
"event": { | ||
"dataset": "elasticsearch.ingest_pipeline", | ||
"module": "elasticsearch", | ||
"duration": 558169708 | ||
}, | ||
"metricset": { | ||
"period": 10000, | ||
"name": "ingest_pipeline" | ||
}, | ||
"service": { | ||
"address": "https://localhost:9200", | ||
"type": "elasticsearch" | ||
} | ||
} |
22 changes: 22 additions & 0 deletions
22
metricbeat/module/elasticsearch/ingest_pipeline/_meta/docs.asciidoc
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,22 @@ | ||
This is the ingest_pipeline metricset of the module elasticsearch. | ||
|
||
Collects metrics on ingest pipeline executions, with processor-level granularity. | ||
|
||
[float] | ||
=== Processor-level metrics sampling | ||
|
||
Processor-level metrics can produce a high volume of data, so the default behavior is to collect those metrics less | ||
frequently than the `period` for pipeline-level metrics, by applying a sampling strategy. By default, the | ||
processor-level metrics will be collected during 25% of the time. This can be configured with the | ||
`ingest.processor_sample_rate` setting: | ||
|
||
[float] | ||
=== Configuration example | ||
[source,yaml] | ||
---- | ||
- module: elasticsearch | ||
period: 10s | ||
metricsets: | ||
- ingest | ||
ingest.processor_sample_rate: 0.1 # decrease to 10% of fetches | ||
---- |
Oops, something went wrong.