🤖 Update Benchmark Results

[thomhurst]

Automated Benchmark Update

This PR updates the benchmark documentation with the latest results from the Speed Comparison workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

• benchmark-DataDrivenTests
• benchmark-AsyncTests
• benchmark-ScaleTests
• benchmark-MatrixTests
• benchmark-MassiveParallelTests
• benchmark-SetupTeardownTests
• benchmark-BuildTime
• benchmark-summary (aggregated overview)

Runtime Benchmarks

• AsyncTests
• DataDrivenTests
• MassiveParallelTests
• MatrixTests
• ScaleTests
• SetupTeardownTests

Build Benchmarks

• BuildTime
• 2026-05-08
• Ubuntu Latest • .NET SDK 10.0.203

Changes

• Updated benchmark data in docs/static/benchmarks/latest.json
• Updated historical trends in docs/static/benchmarks/historical.json
• Regenerated benchmark documentation in docs/docs/benchmarks/index.md
• Updated benchmark summary in docs/static/benchmarks/summary.json

Workflow Run

• Run ID: 25530123418
• Triggered: schedule
• Date:

---

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

[codacy-production]

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

_{NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.}

[claude]

Automated Benchmark Update — 2026-05-08

This is a clean automated data PR. No code changes; all edits are consistent across markdown tables, JSON source files, chart axis ranges, and timestamps.

Data Consistency ✅

Numbers are correctly propagated between latest.json, historical.json, the per-benchmark .md files, and summary.json. Chart y-axis ranges (e.g. 952 → 938 for AsyncTests, 780 → 747 for DataDrivenTests) correctly reflect the new max values.

Performance Trends Worth Watching

Benchmark	TUnit Δ	Notes
AsyncTests	+1.3ms (+0.2%)	Essentially flat; within noise
DataDrivenTests	+28.5ms (+6.6%)	TUnit slower; other frameworks improved 4–11% — could be CI variance or worth a closer look
MassiveParallelTests	-7.9ms (-1.2%)	Improvement
MatrixTests	Minimal change	Stable
ScaleTests	+9.6ms (+2.1%)	Slight increase; competitors also increased
SetupTeardownTests	+15.1ms (+2.7%)	Minor regression across all frameworks (shared infra variance likely)
BuildTime	+10ms (+0.5%)	TUnit slightly up while competitors improved marginally

The DataDrivenTests delta is the most notable: TUnit went from 433ms to 462ms (+6.6%) while NUnit dropped from 640ms to 575ms (-10%). This could be CI scheduling noise on a shared runner, but if this trend persists across a few days it would be worth investigating whether a recent change affected data-driven test enumeration performance.

Automation Quality ✅

The workflow correctly:

• Updates all related files atomically in one PR
• Maintains consistent version numbers across all frameworks (TUnit 1.43.11, NUnit 4.5.1, etc.)
• Carries forward error/StdDev values alongside means and medians
• Regenerates chart axes from actual data

No issues with this PR. The automation is working correctly.