Skip to content

#331 Use Default BenchmarkDotNet job; skip PR benchmarks - #332

Merged
sanelli merged 2 commits into
mainfrom
331-set-benchmark-run-job-to-default-to-reduce-flakiness
Aug 8, 2026
Merged

#331 Use Default BenchmarkDotNet job; skip PR benchmarks#332
sanelli merged 2 commits into
mainfrom
331-set-benchmark-run-job-to-default-to-reduce-flakiness

Conversation

@sanelli

@sanelli sanelli commented Aug 8, 2026

Copy link
Copy Markdown
Owner

Summary

  • Switch BenchmarkDotNet from the Short job to Default in Scripts/RunBenchmarks.ps1 for more stable results (longer wall-clock).
  • Stop running benchmarks on pull requests and stop posting benchmark tables in the PR coverage comment; keep chart-subset runs on main merge CI only.
  • Document the Default job / PR vs main behavior; bump MappaVersion to 10.2.0-alpha.64.

Closes #331

Test plan

  • .\Scripts\RunBenchmarks.ps1 -ChartBenchmarksOnly completed successfully with Default (~13 min)
  • PR CI: version check, build, tests/coverage, coverage comment (no benchmarks)
  • After merge: main workflow still runs ChartBenchmarksOnly + gist update

sanelli and others added 2 commits August 8, 2026 23:19
Switch RunBenchmarks.ps1 from Short to Default, document the longer wall-clock time, and bump to 10.2.0-alpha.63.

Co-authored-by: Cursor <cursoragent@cursor.com>
Keep ChartBenchmarksOnly on main merge CI only. Drop the PR workflow benchmark step and the Benchmarks section from the coverage comment script; bump to 10.2.0-alpha.64.

Co-authored-by: Cursor <cursoragent@cursor.com>
@sanelli sanelli linked an issue Aug 8, 2026 that may be closed by this pull request
3 tasks
@github-actions

github-actions Bot commented Aug 8, 2026

Copy link
Copy Markdown

Code coverage

Compared against the latest published coverage history from the code coverage gist.

Metric Baseline PR Δ Trend
Line 98.4% 98.4% 0 =
Branch 90.9% 90.9% 0 =
Method 100% 100% 0 =

No coverage metric dropped by more than 1 percentage point(s) versus baseline.

@sanelli
sanelli merged commit 99fec9a into main Aug 8, 2026
1 check passed
@sanelli
sanelli deleted the 331-set-benchmark-run-job-to-default-to-reduce-flakiness branch August 8, 2026 22:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Set benchmark run job to Default to reduce flakiness

1 participant