Skip to content

Add charts ranking the longest jobs & tests per block (variant) to the HTML instrumentation report#208

Merged
AlexJones0 merged 1 commit into
lowRISC:masterfrom
AlexJones0:instrumentation_longest_by_block
May 21, 2026
Merged

Add charts ranking the longest jobs & tests per block (variant) to the HTML instrumentation report#208
AlexJones0 merged 1 commit into
lowRISC:masterfrom
AlexJones0:instrumentation_longest_by_block

Conversation

@AlexJones0
Copy link
Copy Markdown
Contributor

@AlexJones0 AlexJones0 commented May 20, 2026

This PR is the fifteenth of a series of PRs to introduce instrumentation reporting to DVSim.

This PR adds the final two remaining visualizations for the HTML instrumentation report implementation: one ranking the top jobs partitioned by block (variant), and another ranking the top tests partitioned by block (variant). Compared to the previous PRs, this should be a lot nicer to review - we're just extending the functionality introduced in the last two PRs via parameterization.

See the commit message for more info.


Here are some examples of the generated metrics.html report from runs on the OpenTitan repository (these can be zoomed in on when rendered in the browser):

  • The "otbn" filtered view of the top jobs by block, generated for an OpenTitan "nightly" run:
image
  • The combined "All categories" view of the top tests by tool, generated for an OpenTitan "weekly" run:
image

Copy link
Copy Markdown
Collaborator

@machshev machshev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @AlexJones0!

Add two more visualizations to the instrumentation report - one showing
the longest jobs per block (variant), and another showing the longest
tests per block (variant). As with the per-tool graphs, these are only
shown if appropriate metadata exists.

Since the test grouping logic was added in the previous commit, this is
implemented by just adding a couple of extra subclasses with a relevant
categorization function and applicable scaling parameters applied. In
this case, we expect to have a lot more blocks than tools, so we have
lower bars being rendered by default.

Signed-off-by: Alex Jones <alex.jones@lowrisc.org>
@AlexJones0 AlexJones0 force-pushed the instrumentation_longest_by_block branch from e7248bd to ad437c2 Compare May 21, 2026 11:20
@AlexJones0 AlexJones0 marked this pull request as ready for review May 21, 2026 11:21
@AlexJones0 AlexJones0 added this pull request to the merge queue May 21, 2026
Merged via the queue into lowRISC:master with commit 08d57ae May 21, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants