Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

opentelemetry-plugin >=2.2.1 won't work with opentelemetry-collector #380

Closed
sappersd opened this issue Mar 23, 2022 · 8 comments
Closed
Labels
bug Something isn't working

Comments

@sappersd
Copy link

sappersd commented Mar 23, 2022

Jenkins and plugins versions report

Environment
Jenkins: 2.339
OS: Linux - 5.4.181-1.el7.elrepo.x86_64
---
Parameterized-Remote-Trigger:3.1.5.1
ace-editor:1.1
active-directory:2.25.1
allure-jenkins-plugin:2.30.2
analysis-model-api:10.9.3
ansible:1.1
ansicolor:1.0.1
ant:1.13
antisamy-markup-formatter:2.7
apache-httpcomponents-client-4-api:4.5.13-1.0
artifactory:3.15.3
authentication-tokens:1.4
aws-java-sdk:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-cloudformation:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-codebuild:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-ec2:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-ecr:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-ecs:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-elasticbeanstalk:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-iam:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-logs:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-minimal:1.12.163-315.v2b_716ec8e4df
aws-java-sdk-ssm:1.12.163-315.v2b_716ec8e4df
aws-secrets-manager-credentials-provider:1.0.0
aws-secrets-manager-secret-source:0.0.2
bootstrap4-api:4.6.0-3
bootstrap5-api:5.1.3-6
bouncycastle-api:2.25
branch-api:2.7.0
build-name-setter:2.2.0
build-pipeline-plugin:1.5.8
build-timeout:1.20
build-timestamp:1.0.3
build-user-vars-plugin:1.8
buildrotator:1.2
caffeine-api:2.9.2-29.v717aac953ff3
checks-api:1.7.2
cloudbees-disk-usage-simple:0.10
cloudbees-folder:6.708.ve61636eb_65a_5
cobertura:1.17
code-coverage-api:2.0.4
command-launcher:1.6
conditional-buildstep:1.4.1
config-file-provider:3.9.0
configuration-as-code:1414.v878271fc496f
configuration-as-code-groovy:1.1
copyartifact:1.46.3
credentials:1074.v60e6c29b_b_44b_
credentials-binding:1.27.1
custom-tools-plugin:0.8
dashboard-view:2.18
data-tables-api:1.11.4-3
display-url-api:2.3.5
docker-build-publish:1.3.3
docker-commons:1.19
docker-java-api:3.1.5.2
docker-plugin:1.2.6
docker-workflow:1.28
dtkit-api:3.0.0
durable-task:493.v195aefbb0ff2
dynamic_extended_choice_parameter:1.0.1
echarts-api:5.3.0-2
email-ext:2.87
emailext-template:1.4
envinject:2.839.v52c702c10635
envinject-api:1.180.v98d833b_27470
extended-choice-parameter:346.vd87693c5a_86c
extended-read-permission:3.2
extensible-choice-parameter:1.8.0
external-monitor-job:191.v363d0d1efdf8
files-found-trigger:1.5
fluentd:0.1.5
font-awesome-api:6.0.0-1
forensics-api:1.12.0
generic-webhook-trigger:1.83
git:4.10.3
git-client:3.11.0
git-parameter:0.9.15
git-server:1.10
github:1.34.3
github-api:1.301-378.v9807bd746da5
github-autostatus:3.6.2
github-branch-source:1583.v18d333ef7379
gitlab-plugin:1.5.29
google-oauth-plugin:1.0.6
gradle:1.38
groovy:2.4
h2-api:1.4.199
handlebars:3.0.8
hashicorp-vault-plugin:336.v182c0fbaaeb7
hidden-parameter:0.0.4
htmlpublisher:1.29
http_request:1.14
ivy:2.1
jackson2-api:2.13.2-260.v43d711474c77
jacoco:3.3.1
javadoc:217.v905b_86277a_2a_
javax-activation-api:1.2.0-2
javax-mail-api:1.6.2-5
jaxb:2.3.0.1
jdk-tool:1.5
jersey2-api:2.35-4
jira-steps:1.6.0
jjwt-api:0.11.2-9.c8b45b8bb173
jnr-posix-api:3.1.7-2
job-dsl:1.78.3
job-parameter-summary:0.5
jquery:1.12.4-1
jquery-detached:1.2.1
jquery3-api:3.6.0-2
jsch:0.1.55.2
junit:1.56
junit-attachments:92.v46b_185115f82
kubernetes:3546.v6103d89542d6
kubernetes-client-api:5.11.2-182.v0f1cf4c5904e
kubernetes-credentials:0.9.0
ldap:2.8
lockable-resources:2.14
mailer:408.vd726a_1130320
mapdb-api:1.0.9.0
mask-passwords:3.0
matrix-auth:3.1
matrix-groovy-execution-strategy:1.0.7
matrix-project:758.v7a_ea_491852f3
maven-artifact-choicelistprovider:1.9.0
maven-plugin:3.18
metrics:4.1.6.1
momentjs:1.1.1
monitoring:1.90.0
nc-jenkins-jobs-importer-plugin:2.0.0
nodejs:1.5.1
oauth-credentials:0.5
okhttp-api:4.9.3-105.vb96869f8ac3a
opentelemetry:2.2.2
pam-auth:1.7
parameterized-scheduler:1.0
parameterized-trigger:2.43
performance:3.20
permissive-script-security:0.7
pipeline-aggregator-view:1.11
pipeline-build-step:2.16
pipeline-github-lib:36.v4c01db_ca_ed16
pipeline-graph-analysis:188.v3a01e7973f2c
pipeline-input-step:446.vf27b_0b_83500e
pipeline-maven:3.10.0
pipeline-milestone-step:100.v60a_03cd446e1
pipeline-model-api:2.2064.v5eef7d0982b_e
pipeline-model-definition:2.2064.v5eef7d0982b_e
pipeline-model-extensions:2.2064.v5eef7d0982b_e
pipeline-rest-api:2.23
pipeline-stage-step:291.vf0a8a7aeeb50
pipeline-stage-tags-metadata:2.2064.v5eef7d0982b_e
pipeline-stage-view:2.23
pipeline-utility-steps:2.12.0
plain-credentials:1.8
plugin-util-api:2.14.0
popper-api:1.16.1-2
popper2-api:2.11.2-1
prism-api:1.26.0-2
publish-over:0.22
python:1.3
rebuild:1.33
remoting-opentelemetry:1.0-rc89.d67d14d05962
resource-disposer:0.17
rich-text-publisher-plugin:1.4
role-strategy:3.2.0
run-condition:1.5
saml:2.291.vd3f2cd6d1c3e
scm-api:595.vd5a_df5eb_0e39
scoring-load-balancer:1.0.1
script-security:1140.vf967fb_efa_55a_
simple-theme-plugin:103.va_161d09c38c7
slave-setup:1.10
snakeyaml-api:1.29.1
ssh-agent:1.24.1
ssh-credentials:1.19
ssh-slaves:1.806.v2253cedd3295
sshd:3.1.0
structs:308.v852b473a2b8c
subversion:2.15.2
throttle-concurrents:2.6
timestamper:1.17
token-macro:280.v97a_82642793c
trilead-api:1.0.13
uno-choice:2.6.0
update-sites-manager:2.0.0
variant:1.4
versioncolumn:2.2
warnings-ng:9.11.1
windows-slaves:1.8
workflow-aggregator:2.7
workflow-api:1143.v2d42f1e9dea_5
workflow-basic-steps:941.vdfe1b_a_132c64
workflow-cps:2660.vb_c0412dc4e6d
workflow-cps-global-lib:564.ve62a_4eb_b_e039
workflow-durable-task-step:1121.va_65b_d2701486
workflow-job:1174.vdcb_d054cf74a_
workflow-multibranch:711.vdfef37cda_816
workflow-remote-loader:1.5
workflow-scm-step:2.13
workflow-step-api:622.vb_8e7c15b_c95a_
workflow-support:815.vd60466279fc8
ws-cleanup:0.40
xunit:3.0.5

What Operating System are you using (both controller, and any agents involved in the problem)?

CentOS 8 Stream

Reproduction steps

I try to use opentelemetry-plugin for sending metrics to prometheus using opentelemetry-collector. But it won't work.
jenkins (opentelemetry-plugin) -> opentelemetry-collector -> prometheus

There are only few metrics appear into prometheus:

otlp_exporter_seen counter
processedSpans counter
queueSize gauge
spans_duration_nano gauge
spans_end_time_unix_nano gauge
spans_response_status gauge

A lot of metrics (I can see it if using Observability Elastic) are absent.

But if I send custom metrics by telegraf (opentelemetry plugin) - I can see metrics into prometheus.

otel/opentelemetry-collector:0.47.0
prom/prometheus:v2.34.0
Telegraf 1.21.4

opentelemetry-collector config:

receivers:
  otlp:
    protocols:
      grpc:
        endpoint: "0.0.0.0:4317"
exporters:
  prometheus:
    endpoint: "0.0.0.0:8889"
    const_labels:
      label1: value1
processors:
  batch:
service:
  pipelines:
    metrics:
      receivers: [otlp]
      processors: [batch]
      exporters: [prometheus]

telegraf that can send data to collector and metrics will appear into prometheus

[tags]
[agent]
  interval = "3s"
  round_interval = true
  metric_batch_size = 1000
  metric_buffer_limit = 10000
  collection_jitter = "0s"
  flush_interval = "10s"
  flush_jitter = "0s"
  debug = false
  quiet = false
  hostname = "localhost"
  omit_hostname = false
[outputs]
[[outputs.opentelemetry]]
service_address = "otel-collector:4317"


[[inputs.exec]]
  commands = [ "/etc/telegraf/scripts/*" ]
  name_prefix = "t_jenkins_"
  data_format = "influx"
  timeout = "30s"
  interval = "10s"

Is it a protocol incompatibility? Or is it my inncorrect configuration?

By the way, if I use last opentelemetry-plugin 2.3.0, than no one metric appear into prometheus.

Expected Results

Actual Results

Anything else?

No response

@sappersd sappersd added the bug Something isn't working label Mar 23, 2022
@cyrille-leclerc
Copy link
Contributor

We continuously test with Otel Collector (0.44.0 for me today) and we use on our production Elastic Jenkins instances with the Otel Collector. I'll deep dive on your problem.

@cyrille-leclerc
Copy link
Contributor

cyrille-leclerc commented Mar 23, 2022

I see the Jenkins metrics verifying on the Prometheus Exposition Format web page published by the Otel Collector Contrib 0.47.0

  • Jenkins OpenTelemetry Plugin 2.3.0
  • OpenTelemetry Collector Contrib 0.47
otel-collector.yml
receivers:
  otlp:
    protocols:
      grpc:
        endpoint: '127.0.0.1:4317'

  #...
extensions:
  zpages:
    endpoint: :55679

receivers:
  otlp:
    protocols:
      grpc:
        endpoint: '127.0.0.1:4317'

  hostmetrics:
    collection_interval: 1m
    scrapers:
      # cpu not supported on MacOS
      # cpu:
      load:
      memory:

processors:
  batch:

exporters:
  otlp/elasticcloud:
    endpoint: "***.apm.europe-west1.gcp.cloud.es.io:443"
    headers:
      Authorization: "Bearer ***"     
  logging:
    loglevel: warn
  logging/debug:
    loglevel: debug
  prometheus:
    endpoint: 0.0.0.0:8889
    resource_to_telemetry_conversion:
        enabled: true
service:
  pipelines:
    metrics:
      receivers:
        - otlp
        - hostmetrics
      processors: [batch]
      exporters:
        - logging
        - prometheus
        - otlp/elasticcloud
    traces:
      receivers:
        - otlp
      processors: [batch]
      exporters:
        - otlp/elasticcloud
    logs:
      receivers: [otlp]
      processors: [batch]
      exporters: 
        - logging/debug
        - otlp/elasticcloud
  extensions: [zpages]
http://localhost:8889/metrics
# HELP ci_pipeline_run_completed Job completed
# TYPE ci_pipeline_run_completed counter
ci_pipeline_run_completed{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP ci_pipeline_run_launched Job launched
# TYPE ci_pipeline_run_launched counter
ci_pipeline_run_launched{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP ci_pipeline_run_started Job started
# TYPE ci_pipeline_run_started counter
ci_pipeline_run_started{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP jenkins_agents_offline Number of offline agents
# TYPE jenkins_agents_offline gauge
jenkins_agents_offline{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP jenkins_agents_online Number of online agents
# TYPE jenkins_agents_online gauge
jenkins_agents_online{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP jenkins_agents_total Number of agents
# TYPE jenkins_agents_total gauge
jenkins_agents_total{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2
# HELP jenkins_disk_usage_bytes Disk usage of first level folder in JENKINS_HOME.
# TYPE jenkins_disk_usage_bytes gauge
jenkins_disk_usage_bytes{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.43768832e+09
# HELP jenkins_queue_blocked Number of blocked items in queue
# TYPE jenkins_queue_blocked gauge
jenkins_queue_blocked{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP jenkins_queue_buildable Number of buildable items in queue
# TYPE jenkins_queue_buildable gauge
jenkins_queue_buildable{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP jenkins_queue_left Total count of left items
# TYPE jenkins_queue_left counter
jenkins_queue_left{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2
# HELP jenkins_queue_time_spent_millis Total time spent in queue by items
# TYPE jenkins_queue_time_spent_millis counter
jenkins_queue_time_spent_millis{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 102
# HELP jenkins_queue_waiting Number of waiting items in queue
# TYPE jenkins_queue_waiting gauge
jenkins_queue_waiting{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP login Logins
# TYPE login counter
login{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP login_success Successful logins
# TYPE login_success counter
login_success{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP otlp_exporter_exported 
# TYPE otlp_exporter_exported counter
otlp_exporter_exported{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="log"} 161
otlp_exporter_exported{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 196
# HELP otlp_exporter_seen 
# TYPE otlp_exporter_seen counter
otlp_exporter_seen{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="log"} 161
otlp_exporter_seen{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 196
# HELP process_cpu_load Process CPU load
# TYPE process_cpu_load gauge
process_cpu_load{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.023051337388955356
# HELP process_cpu_time Process CPU time
# TYPE process_cpu_time counter
process_cpu_time{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.46431498e+11
# HELP processedLogs The number of logs processed by the BatchLogProcessor. [dropped=true if they were dropped due to high throughput]
# TYPE processedLogs counter
processedLogs{dropped="false",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",logProcessorType="BatchLogProcessor",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 161
# HELP processedSpans The number of spans processed by the BatchSpanProcessor. [dropped=true if they were dropped due to high throughput]
# TYPE processedSpans counter
processedSpans{dropped="false",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 196
# HELP queueSize The number of spans queued
# TYPE queueSize gauge
queueSize{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP runtime_jvm_gc_count The number of collections that have occurred for a given JVM garbage collector.
# TYPE runtime_jvm_gc_count gauge
runtime_jvm_gc_count{gc="G1 Old Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
runtime_jvm_gc_count{gc="G1 Young Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 68
# HELP runtime_jvm_gc_time Time spent in a given JVM garbage collector in milliseconds.
# TYPE runtime_jvm_gc_time gauge
runtime_jvm_gc_time{gc="G1 Old Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
runtime_jvm_gc_time{gc="G1 Young Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 671
# HELP runtime_jvm_memory_area Bytes of a given JVM memory area.
# TYPE runtime_jvm_memory_area gauge
runtime_jvm_memory_area{area="heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.009071616e+09
runtime_jvm_memory_area{area="heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 4.294967296e+09
runtime_jvm_memory_area{area="heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 7.76192512e+08
runtime_jvm_memory_area{area="non_heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.03186176e+08
runtime_jvm_memory_area{area="non_heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.89695912e+08
# HELP runtime_jvm_memory_pool Bytes of a given JVM memory pool.
# TYPE runtime_jvm_memory_pool gauge
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.555904e+06
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 5.8368e+06
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.422784e+06
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.1730944e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22912768e+08
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.171648e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 3.538944e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22908672e+08
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 3.5292288e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Compressed Class Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.8558976e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Compressed Class Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.073741824e+09
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Compressed Class Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.536776e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Eden Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.214251008e+09
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Eden Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 6.20756992e+08
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Old Gen",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 7.43440384e+08
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Old Gen",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 4.294967296e+09
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Old Gen",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.04055296e+08
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Survivor Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 5.1380224e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Survivor Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 5.1380224e+07
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Metaspace",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.34950912e+08
runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Metaspace",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.248966e+08
# HELP system_cpu_load System CPU load
# TYPE system_cpu_load gauge
system_cpu_load{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.3945170093535821
# HELP system_cpu_load_average_15m Average CPU Load over 15 minutes.
# TYPE system_cpu_load_average_15m gauge
system_cpu_load_average_15m 6.3857421875
# HELP system_cpu_load_average_1m System CPU load average 1 minute
# TYPE system_cpu_load_average_1m gauge
system_cpu_load_average_1m{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 7.4169921875
# HELP system_cpu_load_average_5m Average CPU Load over 5 minutes.
# TYPE system_cpu_load_average_5m gauge
system_cpu_load_average_5m 9.19677734375
# HELP system_memory_usage Bytes of memory in use.
# TYPE system_memory_usage gauge
system_memory_usage{state="free"} 1.51937024e+08
system_memory_usage{state="inactive"} 5.54848256e+09
system_memory_usage{state="used"} 1.14794496e+10
# HELP system_memory_utilization System memory utilization (0.0 to 1.0)
# TYPE system_memory_utilization gauge
system_memory_utilization{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.9924924373626709
# HELP system_paging_usage System swap usage
# TYPE system_paging_usage gauge
system_paging_usage{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",state="free",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 6.58505728e+08
system_paging_usage{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",state="used",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 4.710203392e+09
# HELP system_paging_utilization System swap utilization (0.0 to 1.0)
# TYPE system_paging_utilization gauge
system_paging_utilization{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.87734375

@cyrille-leclerc
Copy link
Contributor

@sappersd can you verify with a curl http://localhost:8889/metrics if your Jenkins metrics are captured?

@sappersd
Copy link
Author

Thx a lot for your help!

opentelemetry-collector:0.47.0
OpenTelemetry Plugin Version 2.2.1

I just copied your config for collector plugin:

otel-collector-config.yaml
extensions:
  zpages:
    endpoint: :55679

receivers:
  otlp:
    protocols:
      grpc:
        endpoint: '0.0.0.0:4317'

  hostmetrics:
    collection_interval: 1m
    scrapers:
      # cpu not supported on MacOS
      # cpu:
      load:
      memory:

processors:
  batch:

exporters:
  otlp/elasticcloud:
    endpoint: "zzzz:443"
    headers:
      Authorization: "Bearer ***"
  logging:
    loglevel: warn
  logging/debug:
    loglevel: debug
  prometheus:
    endpoint: 0.0.0.0:8889
    resource_to_telemetry_conversion:
        enabled: true
service:
  pipelines:
    metrics:
      receivers:
        - otlp
        - hostmetrics
      processors: [batch]
      exporters:
        - logging
        - prometheus
        - otlp/elasticcloud
    traces:
      receivers:
        - otlp
      processors: [batch]
      exporters:
        - otlp/elasticcloud
    logs:
      receivers: [otlp]
      processors: [batch]
      exporters:
        - logging/debug
        - otlp/elasticcloud
  extensions: [zpages]
curl 127.0.0.1:8889/metrics
# HELP otlp_exporter_exported
# TYPE otlp_exporter_exported counter
otlp_exporter_exported{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 5
# HELP otlp_exporter_seen
# TYPE otlp_exporter_seen counter
otlp_exporter_seen{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 5
# HELP processedSpans The number of spans processed by the BatchSpanProcessor. [dropped=true if they were dropped due to high throughput]
# TYPE processedSpans counter
processedSpans{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",dropped="false",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 5
# HELP queueSize The number of spans queued
# TYPE queueSize gauge
queueSize{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP system_cpu_load_average_15m Average CPU Load over 15 minutes.
# TYPE system_cpu_load_average_15m gauge
system_cpu_load_average_15m 0.05
# HELP system_cpu_load_average_1m Average CPU Load over 1 minute.
# TYPE system_cpu_load_average_1m gauge
system_cpu_load_average_1m 0
# HELP system_cpu_load_average_5m Average CPU Load over 5 minutes.
# TYPE system_cpu_load_average_5m gauge
system_cpu_load_average_5m 0.01
# HELP system_memory_usage Bytes of memory in use.
# TYPE system_memory_usage gauge
system_memory_usage{state="buffered"} 0
system_memory_usage{state="cached"} 4.525432832e+09
system_memory_usage{state="free"} 2.79762944e+09
system_memory_usage{state="slab_reclaimable"} 5.38079232e+08
system_memory_usage{state="slab_unreclaimable"} 1.74862336e+08
system_memory_usage{state="used"} 8.777728e+08

And here are logs for OpenTelemetry Plugin Version 2.3.1-SNAPSHOT (private-d73fc646-root)

curl 127.0.0.1:8889/metrics
# HELP jenkins_agents_offline Number of offline agents
# TYPE jenkins_agents_offline gauge
jenkins_agents_offline{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP jenkins_agents_online Number of online agents
# TYPE jenkins_agents_online gauge
jenkins_agents_online{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP jenkins_agents_total Number of agents
# TYPE jenkins_agents_total gauge
jenkins_agents_total{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP jenkins_disk_usage_bytes Disk usage of first level folder in JENKINS_HOME.
# TYPE jenkins_disk_usage_bytes gauge
jenkins_disk_usage_bytes{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.293890048e+09
# HELP login Logins
# TYPE login counter
login{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP login_success Successful logins
# TYPE login_success counter
login_success{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
# HELP otlp_exporter_exported
# TYPE otlp_exporter_exported counter
otlp_exporter_exported{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 9
otlp_exporter_exported{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 191
# HELP otlp_exporter_seen
# TYPE otlp_exporter_seen counter
otlp_exporter_seen{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 9
otlp_exporter_seen{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 191
# HELP process_cpu_load Process CPU load
# TYPE process_cpu_load gauge
process_cpu_load{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.23484848484848486
# HELP process_cpu_time Process CPU time
# TYPE process_cpu_time counter
process_cpu_time{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.94552e+12
# HELP processedSpans The number of spans processed by the BatchSpanProcessor. [dropped=true if they were dropped due to high throughput]
# TYPE processedSpans counter
processedSpans{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",dropped="false",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 9
processedSpans{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",dropped="false",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 191
# HELP queueSize The number of spans queued
# TYPE queueSize gauge
queueSize{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1
queueSize{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP runtime_jvm_gc_count The number of collections that have occurred for a given JVM garbage collector.
# TYPE runtime_jvm_gc_count gauge
runtime_jvm_gc_count{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Old Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
runtime_jvm_gc_count{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Young Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 24
# HELP runtime_jvm_gc_time Time spent in a given JVM garbage collector in milliseconds.
# TYPE runtime_jvm_gc_time gauge
runtime_jvm_gc_time{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Old Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
runtime_jvm_gc_time{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Young Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2111
# HELP runtime_jvm_memory_area Bytes of a given JVM memory area.
# TYPE runtime_jvm_memory_area gauge
runtime_jvm_memory_area{area="heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.075838976e+09
runtime_jvm_memory_area{area="heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 2.147483648e+09
runtime_jvm_memory_area{area="heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.65494528e+08
runtime_jvm_memory_area{area="non_heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.54214144e+08
runtime_jvm_memory_area{area="non_heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.33895104e+08
# HELP runtime_jvm_memory_pool Bytes of a given JVM memory pool.
# TYPE runtime_jvm_memory_pool gauge
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.752512e+06
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 5.828608e+06
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.655872e+06
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.0354688e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22916864e+08
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 9.762304e+06
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 3.8207488e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22912768e+08
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 3.607296e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Compressed Class Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.5296896e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Compressed Class Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.073741824e+09
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Compressed Class Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.105196e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Eden Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 6.33339904e+08
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Eden Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 5.1380224e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Old Gen",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 3.99507456e+08
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Old Gen",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 2.147483648e+09
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Old Gen",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.71122688e+08
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Survivor Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 4.2991616e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Survivor Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 4.2991616e+07
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Metaspace",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.7760256e+08
runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Metaspace",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.64352008e+08
# HELP system_cpu_load System CPU load
# TYPE system_cpu_load gauge
system_cpu_load{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.008546816960784314
# HELP system_cpu_load_average_15m Average CPU Load over 15 minutes.
# TYPE system_cpu_load_average_15m gauge
system_cpu_load_average_15m 0.05
# HELP system_cpu_load_average_1m System CPU load average 1 minute
# TYPE system_cpu_load_average_1m gauge
system_cpu_load_average_1m{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.38
# HELP system_cpu_load_average_5m Average CPU Load over 5 minutes.
# TYPE system_cpu_load_average_5m gauge
system_cpu_load_average_5m 0.01
# HELP system_memory_usage Bytes of memory in use.
# TYPE system_memory_usage gauge
system_memory_usage{state="buffered"} 0
system_memory_usage{state="cached"} 4.525502464e+09
system_memory_usage{state="free"} 2.782609408e+09
system_memory_usage{state="slab_reclaimable"} 5.38079232e+08
system_memory_usage{state="slab_unreclaimable"} 1.74923776e+08
system_memory_usage{state="used"} 8.927232e+08
# HELP system_memory_utilization System memory utilization (0.0 to 1.0)
# TYPE system_memory_utilization gauge
system_memory_utilization{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.7312078475952148
# HELP system_paging_usage System swap usage
# TYPE system_paging_usage gauge
system_paging_usage{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",state="free",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
system_paging_usage{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",state="used",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0
# HELP system_paging_utilization System swap utilization (0.0 to 1.0)
# TYPE system_paging_utilization gauge
system_paging_utilization{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0

@sappersd
Copy link
Author

I rechecked v2.2.1 - It works as well (there was my mistake into config first time)
It looks like my problem was related with:

    resource_to_telemetry_conversion:
        enabled: true

I am very grateful for your help! But could you please update demos for new versions.

@cyrille-leclerc
Copy link
Contributor

cyrille-leclerc commented Mar 24, 2022

Thanks. Can you confirm we can close the issue?

FYI #381

@sappersd
Copy link
Author

Yes. Thank you.

@cyrille-leclerc
Copy link
Contributor

Hello @sappersd , we run a survey to better understand Jenkins Observability needs and more broadly CI/CD Observability needs, could you by any chance answer it?
https://docs.google.com/forms/d/e/1FAIpQLSezbndR1bpPj4YeWquLLWEYOkEjEI-lSyNbtDUVrR-udpt2lA/viewform?usp=sf_link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants