0.9.2 - Dashboard - No data on 'OpenTelemetry Collector' dashboard

[Kahltril]

Describe the bug
Following update to v0.9.2 we don't see anymore data in 'OpenTelemetry Collector' dashboard.

To Reproduce
Steps to reproduce the behavior:

1. Go to 'Dashboards'
2. Click on 'OpenTelemetry Collector'
3. All widgets show 'No data'

Expected behavior
On previous version we were used to have some data on those graphs too.

Screenshots
Please find below what we have with version 0.9.2:

Desktop (please complete the following information):

• OS: Windows 11
• Browser: Edge
• Version: 135.0.3179.54

Additional context
As testing purpose I went to the Grafana website related to this dashboard (https://grafana.com/grafana/dashboards/15983-opentelemetry-collector/) and downloaded the latest version of it (v0.120.1).
I confirm that with this version I do have some data which are displayed, not in every widget though:

Attachments
I didn't attach any logs for now as wasn't sure exactly which one were needed as related to OpenTelemetry logs. Also in case of need I'll have to reproduce that on another SDBX scenario where we don't have "corporate" data.

Please let me know if something else is needed.

I wish you a nice day,

Best regards

[mikempw]

Ignore this - I completely read this wrong.

[Kahltril]

Dear Mike,

Thank you for your feedback.

📚 Check data types in ast default or big-ip receivers file
Well, I've checked in both files however, I didn't find any data types related to 'OpenTelemetry collector' dashboard.
Maybe I missed something, if that's the case, please feel free to correct me.
I've detailed below additional troubleshooting I did on my side.

📚 Documentation about troubleshooting 'OpenTelemetry collector' dashboard
I've checked the following page related to troubleshooting if Data are not present, more specifically the section about this particular dashboard: https://github.com/f5devcentral/application-study-tool/blob/main/pages/troubleshooting/troubleshooting.md#dashboard-data-not-visible-all-dashboards

It's written that for this dashboard are collected in a different way:

The data in this dashboard is collected through a different mechanism from the rest of the dashboards.
If data is present in this dashboard (but no others), it indicates an issue with the collection of data from the BigIPs.
If no data is present in this dashboard, it indicates a problem with the connection between Prometheus and Grafana.

Also the steps defined for troubleshooting are:
✅ Is the prometheus container running docker ps
I confirm that prometheus container is running:
2ce5dd33ce82 prom/prometheus:v2.54.1 "/bin/prometheus --c…" 2 weeks ago Up 40 hours 0.0.0.0:9090->9090/tcp, [::]:9090->9090/tcp prometheus

✅ Are there any error logs present in the prometheus container (if running or not) docker logs prometheus
I've checked in the following command output if there was any error 'docker logs prometheus' but it wasn't the case.

✅ Can you reach the prometheus interface on port 9090 of the AST host (assuming firewalls are open)
I confirm that I can well reach prometheus on port 9090 and I do well see some OTEL metrics
Then if I look for a specific metrics which is used on the this dashboard 'otelcol_receiver_accepted_metric_points' I confirm that I see some data:

📚 Additional test - Importing the latest dashboard from Grafana
Also, as previously mentioned, I tried to import the latest version (v.0.120.1) of this dashboard from Grafana web site (provided at the bottom of your dashboard) and with this one I partially see some data (see above printscreen).
So I guess that data are well stored in Prometheus and they could be retrieved as it's the case with the new Dashboard version.
What I noticed is that there is a difference between both dashboard in the 'job' template variable definition:

• Provided dashboard: Variable query type set to Label values
• New dashboard: Variable query type set to Query

Thank you in advance for your help and I wish you a nice day,

Best regards

[mikempw]

Would it be possible to contact your account team? They can arrange a live troubleshooting session with me, and it might make things easier? If not, can you go into the config folder, and look at your ast defaults and receivers file, and paste the data type value true/false .

[Kahltril]

Dear Mike,

Thank you for your reply.

Sure, and thank you fro this proposal! I will drop an e-mail to our account team today or tomorrow and referring this Git issue.

Thank you very much and have a nice day,

Best regards

[sbmwelles]

Once determined, please post solution/resolution to this issue, as I am experiencing the same issue.

[mikempw]

Sorry everyone, I completely read the issue wrong. Is it purely the otel dashboard not displaying information?

[clhain]

Otel collector changed the names of some of the metrics used for variables. This has the fix, will work it's way through in PR #185

https://github.com/f5devcentral/application-study-tool/blob/145ca7a75160d4333baa3aba6e1e3fcb18be5b24/services/grafana/provisioning/dashboards/otel-collector/collector-health.json

[Kahltril]

Dear all,

I confirm that on my side JSON provided by clhain fixes this issue for most of the widgets.

There is still dashboard 'total RSS Memory' which has 'No Data':

Thank you very much for your help on this topic and I wish you a nice day,

Best regards

[Kahltril]

💡 Just reopening the issue as I didn't notice that Total RSS memory still has no data.

[mikempw]

Closing the ticket, working on issue in backlog. Will add to release notes.