[O11y][Apache] Migrate `Metrics overview` dashboard visualizations to lens in kibana 8.3.0 #5636

harnish-elastic · 2023-03-22T13:16:35Z

Enhancement

What does this PR do?

Migrate visualizations to lens for Apache integration package
As per discussion with @SubhrataK,
- For Total accesses, Kept the original value (not the k) in this case, as the number of accesses has to be the exact value and not a rounded off version.
Statistics for Apache Lens migration:

Apache Dashboards	Before Migration			After Migration
	Maps	Lens	Visualization	Maps	Lens	Visualization
[Metrics Apache] Overview	0	0	12	0	11	1

Checklist

I have added an entry to my package's changelog.yml file.
I have verified that panels are populated with data.
I have verified that panels are not distorted after being migrated to lens.
I have updated screenshots of dashboard.
I have verified that data count are matching and panel aggregations are same as before.

Author's checklist

Migrated panels should be removed from visualization folder.
Migrated visualizations are populating in current Kibana version 8.3.0 itself.

Related issues

Relates Lens Migration of OBS integrations #5221

Issues Identified

Not able to convert value into human readable format ( Seconds / Minutes / Hours )
- [Lens] Support the duration formatter kibana#153378

Note:

Please refer the following before migrated screenshot for [Metrics Apache] Overview dashboard, because the current screenshot is not updated.

elasticmachine · 2023-03-22T13:30:32Z

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2023-04-10T09:18:13.199+0000
Duration: 15 min 20 sec

Test stats 🧪

Test	Results
Failed	0
Passed	32
Skipped	0
Total	32

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.

kush-elastic · 2023-03-22T13:37:31Z

/test

elasticmachine · 2023-03-22T14:04:20Z

🌐 Coverage report

Name	Metrics % (`covered/total`)	Diff
Packages	100.0% (`2/2`)	💚
Files	50.0% (`2/4`)	👎 -50.0
Classes	50.0% (`2/4`)	👎 -50.0
Methods	70.0% (`28/40`)	👎 -30.0
Lines	70.234% (`210/299`)	👎 -18.896
Conditionals	100.0% (`0/0`)	💚

…into lens_migration-apache-metrics-8.3.0 Conflicts: packages/apache/changelog.yml packages/apache/kibana/visualization/apache-22057f20-3a12-11eb-8946-296aab7b13db.json packages/apache/kibana/visualization/apache-47820ce0-3a1d-11eb-8946-296aab7b13db.json packages/apache/kibana/visualization/apache-99666080-3a20-11eb-8946-296aab7b13db.json packages/apache/manifest.yml

harnish-elastic · 2023-03-31T10:49:41Z

As discussed with @SubhrataK,

For the Not able to convert value into human readable format ( Seconds / Minutes / Hours ), we keep the old visualization as it is due to not having functionality to user to convert into human-readable and also create the separate issue for the same to track in down.
For the issue Not having feature to set last bucket value, we are good with the metrics chart. For the line/area chart we need auto functionality in reduced timerange. So for the time series visualization we still need to discuss with the kibana team.
For the Splitting a chart into multiple smaller charts by a breakdown dimension is not supported in the lens, we are going to migrate into table chart. Also need to re-arrange the dashboard like first metrics, then line/area/bar charts, and the table charts be at last.

…into lens_migration-apache-metrics-8.3.0

harnish-elastic · 2023-04-05T08:18:25Z

@agithomas Updated the PR based on this comment. Thanks!

kush-elastic

LGTM!

agithomas · 2023-04-06T05:51:31Z

@SubhrataK , can you please confirm if the new way of representation is good ? Please refer the screenshot

harnish-elastic · 2023-04-06T12:02:01Z

@agithomas The line split charts are basically splitting charts into 5 or 10 line charts as per provided field. We don't have any functionality to migrate this kind of chart in lens. Also as discuss with @SubhrataK, the splitting chart has poor readability. Hence we have converted to table chart in which user can see their actual values based on time interval. Please refer the screenshot for more information.

harnish-elastic · 2023-04-06T12:18:44Z

As discuss with @SubhrataK, we are going to rename Load1/5/15 to Average server load. Also will change the position of column and rename it like load per 1 min, load per 5 min, load per 15 min.

@agithomas If you feel like there are many fields in the table feel free to suggest any fields that we can remove.

Field names that have used

agithomas · 2023-04-06T13:04:19Z

As discuss with @SubhrataK, we are going to rename Load1/5/15 to Average server load. Also will change the position of column and rename it like load per 1 min, load per 5 min, load per 15 min.

@agithomas If you feel like there are many fields in the table feel free to suggest any fields that we can remove.

Field names that have used

My concern is mainly around representing the CPU usage in tabular manner, when a line graph could explain the trends much better.

harnish-elastic · 2023-04-07T12:16:23Z

@SubhrataK / @agithomas We have converted the line split chart to lens line chart. Let me know if it looks good to you so that we can update the PR accordingly. Please refer this screenshot.

agithomas · 2023-04-08T13:33:36Z

@SubhrataK / @agithomas We have converted the line split chart to lens line chart. Let me know if it looks good to you so that we can update the PR accordingly. Please refer this screenshot.

This looks much better and user friendly. Hope you can update the screenshot.

harnish-elastic · 2023-04-10T09:19:51Z

@agithomas Updated the PR with suggested changes. Thanks!

agithomas

LGTM!

elasticmachine · 2023-04-11T05:35:57Z

Package apache - 1.9.0 containing this change is available at https://epr.elastic.co/search?package=apache

migrate metrics dashboard visualizations to lens

ca62175

kush-elastic requested review from lalit-satapathy, kush-elastic and agithomas March 22, 2023 13:17

kush-elastic assigned harnish-elastic Mar 22, 2023

kush-elastic added enhancement New feature or request Integration:apache Apache HTTP Server v8.3.0 Team:Service-Integrations Label for the Service Integrations team labels Mar 22, 2023

harnish-elastic marked this pull request as ready for review March 22, 2023 13:17

harnish-elastic requested a review from a team as a code owner March 22, 2023 13:17

harnish-elastic mentioned this pull request Mar 22, 2023

[O11y][Apache] Lens Migration #5608

Closed

6 tasks

harnish-elastic marked this pull request as draft March 22, 2023 13:39

update kibana version

2b42a9d

harnish-elastic marked this pull request as ready for review March 22, 2023 13:48

kush-elastic mentioned this pull request Apr 4, 2023

Lens Migration of OBS integrations #5221

Closed

36 tasks

harnish-elastic added 2 commits April 5, 2023 12:13

Merge branch 'main' of https://github.com/harnish-elastic/integrations …

096c625

…into lens_migration-apache-metrics-8.3.0

migrate pending visualizations and re-arrange the order

2337f59

kush-elastic approved these changes Apr 5, 2023

View reviewed changes

harnish-elastic requested a review from a team April 5, 2023 10:09

harnish-elastic requested review from a team as code owners April 5, 2023 10:09

revert changes

8777ad0

harnish-elastic force-pushed the lens_migration-apache-metrics-8.3.0 branch from 7abe485 to 8777ad0 Compare April 5, 2023 10:47

kush-elastic removed request for a team April 5, 2023 10:48

kush-elastic approved these changes Apr 5, 2023

View reviewed changes

update table charts to line charts

07878c2

agithomas approved these changes Apr 10, 2023

View reviewed changes

kush-elastic merged commit 18d1598 into elastic:main Apr 11, 2023

milan-elastic mentioned this pull request Jun 6, 2023

[Meta][Lens migration] Phases and Issues tracker #6489

Closed

5 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[O11y][Apache] Migrate `Metrics overview` dashboard visualizations to lens in kibana 8.3.0 #5636

[O11y][Apache] Migrate `Metrics overview` dashboard visualizations to lens in kibana 8.3.0 #5636

harnish-elastic commented Mar 22, 2023 •

edited

Loading

elasticmachine commented Mar 22, 2023 •

edited

Loading

Build stats

Test stats 🧪

kush-elastic commented Mar 22, 2023

elasticmachine commented Mar 22, 2023 •

edited

Loading

harnish-elastic commented Mar 31, 2023

harnish-elastic commented Apr 5, 2023

kush-elastic left a comment

agithomas commented Apr 6, 2023

harnish-elastic commented Apr 6, 2023

harnish-elastic commented Apr 6, 2023 •

edited

Loading

agithomas commented Apr 6, 2023

harnish-elastic commented Apr 7, 2023

agithomas commented Apr 8, 2023

harnish-elastic commented Apr 10, 2023

agithomas left a comment

elasticmachine commented Apr 11, 2023

[O11y][Apache] Migrate Metrics overview dashboard visualizations to lens in kibana 8.3.0 #5636

[O11y][Apache] Migrate Metrics overview dashboard visualizations to lens in kibana 8.3.0 #5636

Conversation

harnish-elastic commented Mar 22, 2023 • edited Loading

What does this PR do?

Checklist

Author's checklist

Related issues

Issues Identified

elasticmachine commented Mar 22, 2023 • edited Loading

💚 Build Succeeded

Build stats

Test stats 🧪

🤖 GitHub comments

kush-elastic commented Mar 22, 2023

elasticmachine commented Mar 22, 2023 • edited Loading

🌐 Coverage report

harnish-elastic commented Mar 31, 2023

harnish-elastic commented Apr 5, 2023

kush-elastic left a comment

Choose a reason for hiding this comment

agithomas commented Apr 6, 2023

harnish-elastic commented Apr 6, 2023

harnish-elastic commented Apr 6, 2023 • edited Loading

agithomas commented Apr 6, 2023

harnish-elastic commented Apr 7, 2023

agithomas commented Apr 8, 2023

harnish-elastic commented Apr 10, 2023

agithomas left a comment

Choose a reason for hiding this comment

elasticmachine commented Apr 11, 2023

[O11y][Apache] Migrate `Metrics overview` dashboard visualizations to lens in kibana 8.3.0 #5636

[O11y][Apache] Migrate `Metrics overview` dashboard visualizations to lens in kibana 8.3.0 #5636

harnish-elastic commented Mar 22, 2023 •

edited

Loading

elasticmachine commented Mar 22, 2023 •

edited

Loading

elasticmachine commented Mar 22, 2023 •

edited

Loading

harnish-elastic commented Apr 6, 2023 •

edited

Loading