Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Monitoring data is not indexed in ES #6581

Closed
Tracked by #6894
bryce-b opened this issue Nov 11, 2021 · 2 comments · Fixed by elastic/elasticsearch#82401
Closed
Tracked by #6894

Monitoring data is not indexed in ES #6581

bryce-b opened this issue Nov 11, 2021 · 2 comments · Fixed by elastic/elasticsearch#82401

Comments

@bryce-b
Copy link
Contributor

bryce-b commented Nov 11, 2021

APM Server version (apm-server version): v7.16.0-SNAPSHOT

Description of the problem including expected versus actual behavior:

Data captured in .monitoring-beats* indices under beats_stats.metrics.apm-server.sampling.* is not indexed and can not be queried in the Console or charts.

Steps to reproduce:

  1. enable tail-based sampling in the apm-server
    e.g.:
apm-server:
  data_streams:
    enabled: true
  sampling:
    keep_unsampled: false
    tail:
      enabled: true
      ttl: 30s
      interval: 1s
      policies: 
        - sample_rate: 0.1 

  1. enable stack monitoring
  2. try to query beats_stats.metrics.apm-server.sampling.*
    e.g.:
GET .monitoring-beats-7-2021.11.11/_search
{
  "query": {
    "bool": {
      "filter": [
        { 
          "exists": {
            "field": "beats_stats.metrics.apm-server.sampling"
          }
        }
      ]
    }
  }
}

Provide logs (if relevant):

@bryce-b bryce-b added the bug label Nov 11, 2021
@simitt simitt mentioned this issue Dec 17, 2021
21 tasks
@simitt simitt added this to the 8.1 milestone Dec 17, 2021
@simitt simitt changed the title Tail-Based sampling monitoring data is not indexed in ES Monitoring data is not indexed in ES Dec 17, 2021
@axw axw self-assigned this Jan 10, 2022
@axw
Copy link
Member

axw commented Jan 10, 2022

We'll need to update the beats monitoring template in Elasticsearch.

@axw
Copy link
Member

axw commented Jan 11, 2022

The PR for this is in the Elasticsearch repo. I'll label this issue for the test plan now so we don't forget.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants