🤖 Update Mock Benchmark Results#6189
Merged
Merged
Conversation
Contributor
There was a problem hiding this comment.
Automated Benchmark Update — Review
This is a routine automated PR updating mock benchmark data and documentation from the latest CI run (2026-06-08). The changes are purely data-driven: timestamps, numeric benchmark results, chart axis ranges, and JSON payloads.
What Changed
- Timestamps updated across all benchmark
.mdfiles and JSON data files from2026-06-06to2026-06-08. - Benchmark numbers updated for all 6 categories (Callback, CombinedWorkflow, Invocation, MockCreation, Setup, Verification) across all compared libraries (TUnit.Mocks, Imposter, Mockolate, Moq, NSubstitute, FakeItEasy).
- Mermaid chart y-axis ranges automatically scaled to reflect the new data ranges.
Notable Observations
- TUnit.Mocks holds its relative position across all categories — it continues to lead or be competitive in most benchmark scenarios. No regressions evident.
- Moq's Callback times increased notably (~141k ns → ~188k ns), which is an external library variance, not a TUnit concern.
- The automation pipeline correctly generates, formats, and commits both the Markdown docs and the backing JSON data files in sync — no drift between
latest.jsonand the rendered.mdtables.
Assessment
The PR is mechanically correct and well-structured. The automated workflow handles timestamp propagation, data formatting, and chart scaling consistently. No issues found.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Automated Mock Benchmark Update
This PR updates the mock benchmark documentation with the latest results from the Mock Benchmarks workflow.
Benchmarks Produced
Individual benchmark artifacts are available for download:
mock-benchmark-MockCreationmock-benchmark-Setupmock-benchmark-Invocationmock-benchmark-Verificationmock-benchmark-Callbackmock-benchmark-CombinedWorkflowmock-benchmark-summary(aggregated overview)Libraries Compared
Libraries are discovered dynamically from the benchmark output. See the generated
summary.jsonfor the full list.Changes
docs/static/benchmarks/mocks/latest.jsondocs/docs/benchmarks/mocks/docs/static/benchmarks/mocks/summary.jsonWorkflow Run
🤖 This PR was automatically created and will be merged automatically once CI checks pass.