Skip to content

Improvements to the report generation#339

Merged
harriscr merged 4 commits intoceph:mainfrom
harriscr:wip_ch_report_improvements
Sep 5, 2025
Merged

Improvements to the report generation#339
harriscr merged 4 commits intoceph:mainfrom
harriscr:wip_ch_report_improvements

Conversation

@harriscr
Copy link
Contributor

A few quality of life improvements to the report generation added in #320 #321 and #322.

  1. Move the plot legends outside of the graph axes so that it doesn't cover the data.
    The automatic placement was good in most cases, but there were odd cases where data was obscured
  2. Some plot titles were given to 1 decimal place - change this back to 0 decimal places
    e.g. 1024K instead of 1024.0K
  3. An option to not draw error bars on the plots in a report.
    It was found that some error bars were so big that they ended up distorting the axes and stretching the plot
  4. An option to force the regeneration of the intermediate data and plots from the raw data

In 3, and 4 above the current behaviour will remain the default. For 1 and 2 this will become the new default as it makes the charts look better.

Chris Harris added 3 commits August 28, 2025 15:22
Plot the legend for a comparison report below the graph, rather than within the axes
Change the title format from a float to an int value

Signed-off-by: Chris Harris <harriscr@uk.ibm.com>
Add an option to the generate_performance_report.py script to not plot error bars. This will default to False to keep the existing behaviour.

Signed-off-by: Chris Harris <harriscr@uk.ibm.com>
Add a noption to the report generators to force a refresh of the intermediate files and plots

Signed-off-by: Chris Harris <harriscr@uk.ibm.com>
@harriscr harriscr self-assigned this Aug 29, 2025
@harriscr
Copy link
Contributor Author

harriscr commented Sep 4, 2025

Teuthology runs:

perf-basic

https://pulpito.ceph.com/harriscr-2025-09-02_10:27:08-perf-basic-main-distro-default-smithi/

  • All pass

rados/perf

https://pulpito.ceph.com/harriscr-2025-09-02_10:29:00-rados:perf-main-distro-default-smithi/

  • 386 pass
  • 2 fail with:
    "2025-09-02T11:00:53.677444+0000 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log
  • 1 dead trying to image the test machine:
    "2025-09-02T11:00:53.677444+0000 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log
  • 1 fail trying to install pre-reqs:
    "2025-09-02T11:00:53.677444+0000 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log

@harriscr harriscr marked this pull request as ready for review September 4, 2025 12:07
Copy link
Member

@lee-j-sanders lee-j-sanders left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple of very minor typos, otherwise looks good to me. Thanks!

Comments from the code review

Signed-off-by: Chris Harris <harriscr@uk.ibm.com>
@harriscr harriscr merged commit 5f4878a into ceph:main Sep 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants