Elasticsearch Receiver

Status
Stability	beta
Supported pipeline types	metrics
Distributions	contrib

This receiver queries the Elasticsearch node stats and cluster health endpoints in order to scrape metrics from a running elasticsearch cluster.

Prerequisites

This receiver supports Elasticsearch versions 7.9+

If Elasticsearch security features are enabled, you must have either the monitor or manage cluster privilege. See the Elasticsearch docs for more information on authorization and Security privileges.

Configuration

The following settings are optional:

• metrics (default: see DefaultMetricsSettings here: Allows enabling and disabling specific metrics from being collected in this receiver.
• nodes (default: ["_all"]): Allows specifying node filters that define which nodes are scraped for node-level metrics. See the Elasticsearch documentation for allowed filters. If this option is left explicitly empty, then no node-level metrics will be scraped.
• skip_cluster_metrics (default: false): If true, cluster-level metrics will not be scraped.
• endpoint (default = http://localhost:9200): The base URL of the Elasticsearch API for the cluster to monitor.
• username (no default): Specifies the username used to authenticate with Elasticsearch using basic auth. Must be specified if password is specified.
• password (no default): Specifies the password used to authenticate with Elasticsearch using basic auth. Must be specified if username is specified.
• collection_interval (default = 10s): This receiver collects metrics on an interval. This value must be a string readable by Golang's time.ParseDuration. On larger clusters, the interval may need to be lengthened, as querying Elasticsearch for metrics will take longer on clusters with more nodes.

Example Configuration

receivers:
  elasticsearch:
    metrics:
      elasticsearch.node.fs.disk.available:
        enabled: false
    nodes: ["_local"]
    skip_cluster_metrics: true
    endpoint: http://localhost:9200
    username: otel
    password: password
    collection_interval: 10s

The full list of settings exposed for this receiver are documented here with detailed sample configurations here.

Metrics

The following metric are available with versions:

• elasticsearch.indexing_pressure.memory.limit >= 7.10
• elasticsearch.node.shards.data_set.size >= 7.13
• elasticsearch.cluster.state_update.count >= 7.16.0
• elasticsearch.cluster.state_update.time >= 7.16.0

Details about the metrics produced by this receiver can be found in metadata.yaml

Feature gate configurations

Transition from metrics with "direction" attribute

The proposal to change metrics from being reported with a direction attribute has been reverted in the specification. As a result, the following feature gates will be removed in v0.62.0:

• receiver.elasticsearchreceiver.emitMetricsWithoutDirectionAttribute
• receiver.elasticsearchreceiver.emitMetricsWithDirectionAttribute

For additional information, see open-telemetry/opentelemetry-specification#2726.