Skip to content

Add benchmark performance gate to NUKE CI#129

Merged
Kiryuumaru merged 4 commits into
masterfrom
ci/benchmark-gate-build-suite
May 20, 2026
Merged

Add benchmark performance gate to NUKE CI#129
Kiryuumaru merged 4 commits into
masterfrom
ci/benchmark-gate-build-suite

Conversation

@Kiryuumaru
Copy link
Copy Markdown
Owner

Summary

  • Adds a PR-only benchmark_test entry in build/Build.cs instead of a standalone workflow.
  • Runs the existing Docker comparison suite from benchmarks/docker/run-docker.sh.
  • Reuses the same comparison matrix documented in docs/benchmarks.md: NetConduit Mux TCP vs FRP/Yamux and Smux for throughput and game-tick workloads.
  • Asserts NetConduit / Go-mux geometric mean speedup thresholds:
    • Throughput: >= 1.5x (+0.5x)
    • Game-tick: >= 2.0x (+1.0x)
  • Regenerates .github/workflows/nuke-cicd.yml from NUKE so CI includes a separate Test Benchmarks job.

Verification

  • dotnet build build/_build.csproj -c Release --nologo
  • ./build.ps1 githubworkflow

Note

This PR intentionally enforces the requested thresholds. Based on the latest benchmark data, the game-tick gate should pass, while the throughput gate may fail against Smux unless throughput is improved or the threshold policy is changed.

@Kiryuumaru Kiryuumaru enabled auto-merge (squash) May 20, 2026 02:24
@Kiryuumaru Kiryuumaru disabled auto-merge May 20, 2026 02:28
@Kiryuumaru Kiryuumaru enabled auto-merge (squash) May 20, 2026 02:37
@Kiryuumaru Kiryuumaru disabled auto-merge May 20, 2026 02:39
@Kiryuumaru Kiryuumaru merged commit 7e3fc31 into master May 20, 2026
33 of 34 checks passed
@Kiryuumaru Kiryuumaru deleted the ci/benchmark-gate-build-suite branch May 20, 2026 02:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant